00000001:02000400:3.0F:1789762730.152285:0:3096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789762738.447201:0:3295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789762739.242251:0:3357:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1603 MB/s 00000001:01000000:2.0:1789762739.491870:0:3357:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1891 MB/s 00000001:01000000:2.0:1789762739.741828:0:3357:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 11379 MB/s 00000020:02000000:0.0F:1789762739.966289:0:3386:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_106_ge548d24 00000400:02000000:3.0:1789762740.240934:0:3401:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.136@tcp [8/256/0/180] 00008000:02000000:2.0:1789762742.344617:0:3554:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789762758.258074:0:5154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789762762.553036:0:5901:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789762762.553041:0:5901:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789762762.553043:0:5901:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789762762.553167:0:5901:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000035080baf 00000080:02000400:3.0:1789762762.553176:0:5901:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789762762.557036:0:5901:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789762762.557044:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789762762.557066:0:5901:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001de62729) 00000020:00000080:3.0:1789762762.557086:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789762762.578261:0:5901:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789762762.578303:0:5901:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789762762.588537:0:5901:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789762762.588681:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789762762.588687:0:5901:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789762762.588694:0:5901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5915dfb1c1b58e7b 00000020:01000004:3.0:1789762762.588699:0:5901:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789762762.588702:0:5901:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789762762.588705:0:5901:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000035080baf from MGS 00000020:01000004:3.0:1789762762.588708:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789762762.588715:0:5901:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000077803a05) 00000020:00000080:3.0:1789762762.588722:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789762762.588797:0:5901:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000035080baf from MGS, refs=2 00080000:01000000:3.0:1789762762.588802:0:5901:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789762762.588817:0:5901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5915dfb1c1b58e89 00000100:00100000:3.0:1789762762.588880:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789762762.588996:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789762762.589001:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0F:1789762762.589206:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789762762.589216:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789762762.589659:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762762.589801:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789762762.589806:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789762762.590094:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789762762.590100:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789762762.590272:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789762762.590282:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789762762.590570:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762762.590573:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762762.590574:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762762.590716:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762762.590718:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762762.590720:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762762.591032:0:5901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789762762.593981:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789762762.840784:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6483 MB/s 00000001:01000000:1.0:1789762763.090784:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7603 MB/s 00000001:01000000:1.0:1789762763.341035:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1575 MB/s 00000001:01000000:1.0:1789762763.591211:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1871 MB/s 00080000:10000000:1.0:1789762763.594018:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1789762763.598742:0:5901:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789762763.599111:0:5916:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789762763.599134:0:5901:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789762763.599172:0:5901:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789762763.599320:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789762763.599351:0:5901:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789762763.599889:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762763.600118:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789762763.600124:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789762763.600487:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789762763.600497:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789762763.600700:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789762763.600708:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789762763.601077:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:0.0:1789762763.601091:0:5921:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1789762763.601093:0:5901:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.136@tcp' 00000020:01000004:1.0:1789762763.601096:0:5901:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789762763.601131:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.136@tcp (typ=mgc) 00000020:00000080:1.0:1789762763.601148:0:5901:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.136@tcp (0000000003dc0014) 00000020:00000080:1.0:1789762763.601161:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789762763.601278:0:5901:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002f34c8ae@MGC192.168.203.136@tcp: add connection 192.168.203.136@tcp at head 00010000:00010000:1.0:1789762763.601423:0:5901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.136@tcp-0 is initialized 00000040:01000000:1.0:1789762763.601430:0:5901:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789762763.602231:0:5922:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789762763.602275:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.136@tcp (uuid 9bdabba9-4e53-49d7-a41a-aa00b9b69f52) 00000020:00000080:3.0:1789762763.602291:0:5901:0:(genops.c:1385:class_connect()) connect: client 9bdabba9-4e53-49d7-a41a-aa00b9b69f52, cookie 0x5915dfb1c1b58e97 00000100:00080000:3.0:1789762763.602310:0:5901:0:(import.c:510:import_select_connection()) MGC192.168.203.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789762763.602317:0:5901:0:(import.c:624:import_select_connection()) MGC192.168.203.136@tcp: import 000000002f34c8ae using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1789762763.602359:0:5901:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d89db924 x1876702254858368/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789762763.602384:0:5901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9bdabba9-4e53-49d7-a41a-aa00b9b69f52->MGS 00000020:01000004:3.0:1789762763.602406:0:5901:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789762763.602410:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789762763.602418:0:5901:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005db881d3) 00000020:00000080:3.0:1789762763.602428:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789762763.602453:0:3416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d89db924 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3416:1876702254858368:0@lo:250: 00000100:00100000:1.0:1789762763.602510:0:3416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762763.602538:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254858368 00000100:00100000:0.0:1789762763.602546:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254858368 00000100:00100000:0.0:1789762763.602586:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789762763.602592:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c33d9741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3416:x1876702254858368:12345-0@lo:250: 00010000:00080000:0.0:1789762763.602611:0:5917:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9bdabba9-4e53-49d7-a41a-aa00b9b69f52@0@lo t0 exp 0000000000000000 cur 66 last 0 00000020:00000080:0.0:1789762763.602634:0:5917:0:(genops.c:1385:class_connect()) connect: client 9bdabba9-4e53-49d7-a41a-aa00b9b69f52, cookie 0x5915dfb1c1b58ea5 00000100:00080000:0.0:1789762763.602733:0:5917:0:(import.c:65:import_set_state_nolock()) 000000006230107e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789762763.602801:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c33d9741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:3416:x1876702254858368:12345-0@lo:250: Request processed in 208us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.602807:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789762763.602839:0:3416:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789762763.602846:0:3416:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.136@tcp: connect to target with instance 0 00000100:00080000:0.0:1789762763.602852:0:3416:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789762763.602856:0:3416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789762763.602858:0:3416:0:(import.c:65:import_set_state_nolock()) 000000002f34c8ae MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789762763.602860:0:3416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789762763.602867:0:3416:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789762763.602870:0:3416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d89db924 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3416:1876702254858368:0@lo:250: 00000100:00100000:2.0:1789762763.607595:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789762763.607734:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789762763.607739:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789762763.608177:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789762763.608183:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789762763.608439:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789762763.608444:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789762763.608964:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789762763.609074:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789762763.609079:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789762763.609350:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789762763.609355:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789762763.628037:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789762763.628207:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789762763.628211:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789762763.628857:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789762763.628865:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789762763.629237:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789762763.629320:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789762763.629323:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789762763.629597:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789762763.629604:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789762763.630042:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762763.630178:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789762763.630182:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789762763.630464:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789762763.630476:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789762763.630883:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762763.631080:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789762763.631085:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789762763.631361:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789762763.631367:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789762763.641678:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789762763.641887:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789762763.641892:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789762763.642639:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789762763.642645:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00010000:00010000:3.0:1789762763.642840:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762763.643248:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789762763.643253:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789762763.643855:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789762763.643876:0:5901:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789762763.643880:0:5901:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789762763.643974:0:5901:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789762763.644000:0:5901:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.136@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789762763.644004:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789762763.644005:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789762763.644006:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762763.644007:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789762763.644008:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762763.644010:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762763.644010:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789762763.644011:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789762763.644012:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789762763.644013:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789762763.644014:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762763.644015:0:5901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789762763.644017:0:5901:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789762763.644018:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789762763.644019:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789762763.644020:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762763.644020:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789762763.644021:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762763.644022:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762763.644022:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789762763.644023:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789762763.644023:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789762763.644024:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789762763.644025:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762763.644025:0:5901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789762763.644049:0:5901:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789762763.644061:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858496:0@lo:253: 00000100:00100000:3.0:1789762763.644112:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762763.644144:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254858496 00000100:00100000:3.0:1789762763.644151:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053839294 going to sleep for 11 seconds 00000100:00100000:1.0:1789762763.644153:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254858496 00000100:00100000:1.0:1789762763.644194:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762763.644201:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008196bc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:5901:x1876702254858496:12345-0@lo:253: 20000000:01000000:1.0:1789762763.644239:0:5920:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789762763.644241:0:5920:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789762763.644453:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789762763.644479:0:5920:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789762763.644713:0:5920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789762763.645377:0:5941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789762763.645448:0:5920:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789762763.645451:0:5920:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789762763.645455:0:5920:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789762763.645457:0:5920:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789762763.645466:0:5920:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789762763.645550:0:5920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789762763.645648:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789762763.645660:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789762763.645673:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789762763.645691:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789762763.645708:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789762763.645771:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789762763.645778:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789762763.645799:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789762763.645803:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789762763.645811:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789762763.645814:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789762763.645826:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789762763.645835:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789762763.645855:0:5920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789762763.645858:0:5920:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789762763.645862:0:5920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789762763.645944:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789762763.645952:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789762763.645962:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789762763.645970:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789762763.645978:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789762763.645983:0:5920:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789762763.645999:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789762763.646003:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789762763.646010:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789762763.646018:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789762763.646026:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789762763.646031:0:5920:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789762763.646042:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789762763.646047:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789762763.646053:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789762763.646061:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789762763.646100:0:5920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789762763.646115:0:5920:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789762763.646120:0:5920:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789762763.646311:0:5942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789762763.646412:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789762763.646429:0:5920:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.136@tcp for mdt 20000000:01000000:0.0:1789762763.646431:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1789762763.646446:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789762763.646453:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789762763.646466:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789762763.646481:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1789762763.646493:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789762763.646498:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789762763.646505:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789762763.646514:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789762763.646532:0:5920:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789762763.646534:0:5920:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789762763.646537:0:5920:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789762763.646576:0:5920:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789762763.646577:0:5920:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789762763.646734:0:5943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789762763.646823:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789762763.646836:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789762763.646844:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1789762763.646850:0:5920:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789762763.646851:0:5920:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789762763.647043:0:5944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789762763.647099:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789762763.647112:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789762763.647120:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789762763.647126:0:5920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789762763.647128:0:5920:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789762763.647130:0:5920:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789762763.647132:0:5920:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789762763.647135:0:5920:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789762763.647139:0:5920:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789762763.647315:0:5945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789762763.647349:0:5920:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789762763.650983:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789762763.650996:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789762763.651005:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789762763.651013:0:5920:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789762763.651027:0:5920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651039:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651047:0:5920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651051:0:5920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651055:0:5920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651059:0:5920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651064:0:5920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081344f69 already unused, calling callback (000000005d1ddb1e) 00010000:00010000:1.0:1789762763.651066:0:5920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651071:0:5920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651081:0:5920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651093:0:5920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.651097:0:5920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081344f69/0x5915dfb1c1b58eac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789762763.651108:0:5920:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789762763.654293:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008196bc1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:5901:x1876702254858496:12345-0@lo:253: Request processed in 10091us (10178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762763.654303:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789762763.654313:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858496:0@lo:253: 10000000:01000000:3.0:1789762763.654326:0:5901:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789762763.654328:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789762763.654329:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789762763.654330:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762763.654332:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789762763.654333:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762763.654334:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762763.654335:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789762763.654336:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789762763.654338:0:5901:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789762763.654339:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762763.654340:0:5901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789762763.654353:0:5901:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000035080baf from lustre-MDT0000 10000000:01000000:3.0:1789762763.654370:0:5901:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789762763.654371:0:5901:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789762763.654375:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b33d8ce99b8 10000000:01000000:3.0:1789762763.654377:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789762763.654382:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b33d8ce99b8 from 1 10000000:01000000:3.0:1789762763.654384:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789762763.654401:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000000d365a08/0x5915dfb1c1b58eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.654408:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 000000000d365a08/0x5915dfb1c1b58eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.654413:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000000d365a08/0x5915dfb1c1b58eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.654422:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858624:0@lo:101: 00000100:00100000:3.0:1789762763.654454:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.654486:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000086b3fa8 going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.654489:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254858624 00000100:00100000:0.0:1789762763.654498:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254858624 00000100:00100000:0.0:1789762763.654538:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789762763.654546:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013459d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:5901:x1876702254858624:12345-0@lo:101: 00010000:00010000:0.0:1789762763.654555:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762763.654565:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000192d3a6c/0x5915dfb1c1b58eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58eb3 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.654588:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000192d3a6c/0x5915dfb1c1b58eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 6 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.654595:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000192d3a6c/0x5915dfb1c1b58eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 6 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.654600:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000192d3a6c, rc 0) 00000100:00100000:0.0:1789762763.654630:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013459d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+6:5901:x1876702254858624:12345-0@lo:101: Request processed in 86us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.654635:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789762763.654663:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858624:0@lo:101: 00010000:00010000:3.0:1789762763.654673:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000000d365a08/0x5915dfb1c1b58eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.654678:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000000d365a08/0x5915dfb1c1b58eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.654721:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858752:0@lo:501: 00000100:00100000:3.0:1789762763.654741:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.654783:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000086b3fa8 going to sleep for 11 seconds 00000100:00100000:1.0:1789762763.654789:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254858752 00000100:00100000:1.0:1789762763.654794:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254858752 00000100:00100000:1.0:1789762763.654821:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789762763.654826:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc5f119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+6:5901:x1876702254858752:12345-0@lo:501: 00000100:00100000:1.0:1789762763.654873:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc5f119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+6:5901:x1876702254858752:12345-0@lo:501: Request processed in 48us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789762763.654879:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789762763.654895:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858752:0@lo:501: 10000000:01000000:3.0:1789762763.654928:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789762763.654937:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000000d365a08/0x5915dfb1c1b58eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.654942:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 000000000d365a08/0x5915dfb1c1b58eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762763.654946:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b33c8a8a800 10000000:01000000:3.0:1789762763.654950:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789762763.654953:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b33c8a8a800 10000000:01000000:3.0:1789762763.654956:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789762763.654959:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b33c8a8a800 from 1 10000000:01000000:3.0:1789762763.654961:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789762763.654975:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 00000000d86aa8bb/0x5915dfb1c1b58ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.654992:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 00000000d86aa8bb/0x5915dfb1c1b58ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.655000:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 00000000d86aa8bb/0x5915dfb1c1b58ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.655011:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858880:0@lo:101: 00000100:00100000:3.0:1789762763.655031:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.655044:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000086b3fa8 going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.655063:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254858880 00000100:00100000:0.0:1789762763.655068:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254858880 00000100:00100000:0.0:1789762763.655091:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789762763.655096:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f2ab4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+6:5901:x1876702254858880:12345-0@lo:101: 00010000:00010000:0.0:1789762763.655102:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762763.655108:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d64d070/0x5915dfb1c1b58ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58ec1 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.655118:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d64d070/0x5915dfb1c1b58ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58ec1 expref: 7 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.655123:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d64d070/0x5915dfb1c1b58ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58ec1 expref: 7 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.655127:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d64d070, rc 0) 00000100:00100000:0.0:1789762763.655187:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f2ab4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+7:5901:x1876702254858880:12345-0@lo:101: Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.655194:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789762763.655248:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254858880:0@lo:101: 00010000:00010000:3.0:1789762763.655260:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 00000000d86aa8bb/0x5915dfb1c1b58ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ec8 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.655266:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 00000000d86aa8bb/0x5915dfb1c1b58ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58ec8 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762763.655274:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789762763.655284:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 00000000d86aa8bb/0x5915dfb1c1b58ec1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ec8 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.655288:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 00000000d86aa8bb/0x5915dfb1c1b58ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ec8 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762763.655293:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789762763.655296:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789762763.655300:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b33c8a8a800 10000000:01000000:3.0:1789762763.655303:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789762763.655323:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789762763.655331:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789762763.655345:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000003c0e9b27/0x5915dfb1c1b58ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.655351:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 000000003c0e9b27/0x5915dfb1c1b58ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.655356:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000003c0e9b27/0x5915dfb1c1b58ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.655366:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859008:0@lo:101: 00000100:00100000:3.0:1789762763.655405:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.655419:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000086b3fa8 going to sleep for 11 seconds 00000100:00100000:1.0:1789762763.655455:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859008 00000100:00100000:1.0:1789762763.655459:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859008 00000100:00100000:1.0:1789762763.655481:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789762763.655485:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a78c2764 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+7:5901:x1876702254859008:12345-0@lo:101: 00010000:00010000:1.0:1789762763.655491:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762763.655496:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000020b78a7a/0x5915dfb1c1b58ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58ecf expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.655507:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000020b78a7a/0x5915dfb1c1b58ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 8 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.655522:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000020b78a7a/0x5915dfb1c1b58ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 8 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.655527:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000020b78a7a, rc 0) 00000100:00100000:1.0:1789762763.655552:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a78c2764 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+8:5901:x1876702254859008:12345-0@lo:101: Request processed in 66us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762763.655557:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789762763.655577:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859008:0@lo:101: 00010000:00010000:3.0:1789762763.655586:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000003c0e9b27/0x5915dfb1c1b58ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.655591:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000003c0e9b27/0x5915dfb1c1b58ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.655626:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859136:0@lo:501: 00000100:00100000:3.0:1789762763.655644:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.655657:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000086b3fa8 going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.655674:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859136 00000100:00100000:0.0:1789762763.655679:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859136 00000100:00100000:0.0:1789762763.655702:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789762763.655705:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba5c2015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+8:5901:x1876702254859136:12345-0@lo:501: 00000100:00100000:0.0:1789762763.655781:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba5c2015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5901:x1876702254859136:12345-0@lo:501: Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.655788:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789762763.655806:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859136:0@lo:501: 00000100:00100000:3.0:1789762763.655825:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859264:0@lo:503: 00000100:00100000:3.0:1789762763.655868:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.655889:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000086b3fa8 going to sleep for 11 seconds 00000100:00100000:1.0:1789762763.655900:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859264 00000100:00100000:1.0:1789762763.655906:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859264 00000100:00100000:1.0:1789762763.655959:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789762763.655963:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000423600ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5901:x1876702254859264:12345-0@lo:503: 00000100:00100000:1.0:1789762763.656017:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000423600ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5901:x1876702254859264:12345-0@lo:503: Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762763.656023:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789762763.656043:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859264:0@lo:503: 00000100:00100000:1.0:1789762763.656315:0:5946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5946:1876702254859392:0@lo:502: 00000100:00100000:1.0:1789762763.656347:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762763.656362:0:5946:0:(client.c:2715:ptlrpc_set_wait()) set 000000005fd5dcb2 going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.656384:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859392 00000100:00100000:0.0:1789762763.656389:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859392 00000100:00100000:0.0:1789762763.656410:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789762763.656415:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b201425 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5946:x1876702254859392:12345-0@lo:502: 00000100:00100000:0.0:1789762763.656478:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b201425 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5946:x1876702254859392:12345-0@lo:502: Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.656485:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789762763.656487:0:5946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5946:1876702254859392:0@lo:502: 00000020:01000000:1.0:1789762763.656509:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789762763.656517:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.656519:0:5946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789762763.656522:0:5946:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789762763.656524:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789762763.656534:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005cf91dfe) 00000020:00000080:1.0:1789762763.656544:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789762763.656548:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789762763.656612:0:5946:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789762763.656630:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5915dfb1c1b58ee4 00000020:00000080:1.0:1789762763.656878:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789762763.656881:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762763.656884:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.656885:0:5946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789762763.656887:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789762763.656889:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.656890:0:5946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789762763.656893:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789762763.656899:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000dc944604) 00000020:00000080:1.0:1789762763.656909:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789762763.656934:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789762763.656937:0:5946:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789762763.656939:0:5946:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789762763.656945:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789762763.656974:0:5946:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000035080baf from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789762763.656983:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000debddbff) 00000020:00000080:1.0:1789762763.656989:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789762763.657030:0:5946:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789762763.657033:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5915dfb1c1b58ef9 00000020:00000080:1.0:1789762763.657100:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789762763.657104:0:5946:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789762763.657107:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5915dfb1c1b58f00 00080000:01000000:1.0:1789762763.657111:0:5946:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789762763.657113:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5915dfb1c1b58f07 00080000:10000000:1.0:1789762763.657329:0:5946:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789762763.657437:0:5946:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789762763.659415:0:5946:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789762763.693488:0:5946:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789762763.693720:0:5946:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789762763.695208:0:5946:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789762763.695371:0:5946:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789762763.696623:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004dac0503) 00000020:00000080:1.0:1789762763.696649:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789762763.696729:0:5946:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789762763.696735:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5915dfb1c1b58f15 00000020:00000080:2.0:1789762763.697103:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789762763.698146:0:5946:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789762763.699257:0:5946:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789762763.700176:0:5946:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789762763.701242:0:5946:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789762763.702117:0:5946:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789762763.702941:0:5946:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789762763.703653:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5915dfb1c1b58f1c 00000020:00000080:1.0:1789762763.703835:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789762763.703843:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762763.703848:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.703850:0:5946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789762763.703851:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789762763.703854:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.703855:0:5946:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789762763.703856:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789762763.703857:0:5946:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789762763.703859:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762763.703860:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.703861:0:5946:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789762763.703862:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789762763.703864:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.703865:0:5946:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789762763.703868:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789762763.703889:0:5946:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789762763.703943:0:5946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5946:1876702254859520:0@lo:502: 00000100:00100000:1.0:1789762763.704000:0:5946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762763.704041:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859520 00000100:00100000:1.0:1789762763.704042:0:5946:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008e608a1 going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.704050:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859520 00000100:00100000:0.0:1789762763.704087:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789762763.704095:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e89bb5ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5946:x1876702254859520:12345-0@lo:502: 00000100:00100000:0.0:1789762763.704203:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e89bb5ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5946:x1876702254859520:12345-0@lo:502: Request processed in 109us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.704211:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789762763.704240:0:5946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5946:1876702254859520:0@lo:502: 00000020:01000000:1.0:1789762763.704265:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789762763.704268:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789762763.704269:0:5946:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789762763.704271:0:5946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789762763.704332:0:5901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789762763.704353:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789762763.704368:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000003c0e9b27/0x5915dfb1c1b58ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.704377:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 000000003c0e9b27/0x5915dfb1c1b58ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762763.704383:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b33c8a8a800 from 1 10000000:01000000:3.0:1789762763.704386:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789762763.704406:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.704411:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.704425:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.704436:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859648:0@lo:101: 00000100:00100000:3.0:1789762763.704461:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.704475:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d030f3b going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.704518:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859648 00000100:00100000:0.0:1789762763.704529:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859648 00000100:00100000:0.0:1789762763.704575:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789762763.704580:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a64caf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:5901:x1876702254859648:12345-0@lo:101: 00010000:00010000:0.0:1789762763.704587:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762763.704596:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58f23 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.704622:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.704629:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.704636:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000496ab646, rc 0) 00000100:00100000:0.0:1789762763.704662:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a64caf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:5901:x1876702254859648:12345-0@lo:101: Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.704666:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789762763.704691:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859648:0@lo:101: 00010000:00010000:3.0:1789762763.704701:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.704708:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.705217:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859776:0@lo:256: 00000100:00100000:3.0:1789762763.705243:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.705262:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d030f3b going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.705314:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859776 00000100:00100000:0.0:1789762763.705319:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859776 00000100:00100000:0.0:1789762763.705350:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789762763.705359:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe362f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:5901:x1876702254859776:12345-0@lo:256: 20000000:01000000:0.0:1789762763.705374:0:5920:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789762763.705379:0:5920:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789762763.705445:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe362f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:5901:x1876702254859776:12345-0@lo:256: Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.705451:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789762763.705458:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859776:0@lo:256: 10000000:01000000:3.0:1789762763.706012:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789762763.706024:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.706029:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762763.706033:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33c8a8a800 from 1 10000000:01000000:3.0:1789762763.706035:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789762763.706047:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.706051:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.706056:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.706064:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859904:0@lo:101: 00000100:00100000:3.0:1789762763.706084:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.706101:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d030f3b going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.706122:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254859904 00000100:00100000:0.0:1789762763.706126:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254859904 00000100:00100000:0.0:1789762763.706148:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789762763.706152:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000168570a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:5901:x1876702254859904:12345-0@lo:101: 00010000:00010000:0.0:1789762763.706158:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762763.706164:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58f31 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.706175:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.706187:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.706192:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096494776, rc 0) 00000100:00100000:0.0:1789762763.706218:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000168570a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5901:x1876702254859904:12345-0@lo:101: Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.706222:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789762763.706244:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254859904:0@lo:101: 00010000:00010000:3.0:1789762763.706252:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.706836:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.706873:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860032:0@lo:501: 00000100:00100000:3.0:1789762763.706893:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.706910:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d030f3b going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.706963:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860032 00000100:00100000:0.0:1789762763.706969:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860032 00000100:00100000:0.0:1789762763.706998:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789762763.707004:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d18d87b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5901:x1876702254860032:12345-0@lo:501: 00000100:00100000:0.0:1789762763.707128:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d18d87b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5901:x1876702254860032:12345-0@lo:501: Request processed in 124us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.707134:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789762763.707163:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860032:0@lo:501: 00000100:00100000:3.0:1789762763.707194:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860160:0@lo:503: 00000100:00100000:3.0:1789762763.707227:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.707245:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d030f3b going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.707262:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860160 00000100:00100000:0.0:1789762763.707267:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860160 00000100:00100000:0.0:1789762763.707292:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789762763.707297:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7ad23c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5901:x1876702254860160:12345-0@lo:503: 00000040:00080000:0.0:1789762763.707340:0:5917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789762763.707383:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7ad23c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5901:x1876702254860160:12345-0@lo:503: Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.707391:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789762763.707404:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860160:0@lo:503: 00000040:00080000:3.0:1789762763.708054:0:5950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789762763.708102:0:5901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789762763.708118:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789762763.708128:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.708141:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762763.708177:0:5901:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789762763.708179:0:5901:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b33c8a8a800 10000000:01000000:1.0:1789762763.708181:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b33c8a8a800 10000000:01000000:1.0:1789762763.708184:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789762763.708187:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33c8a8a800 from 1 10000000:01000000:1.0:1789762763.708188:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789762763.708201:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 0000000081344f69/0x5915dfb1c1b58f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.708206:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 0000000081344f69/0x5915dfb1c1b58f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.708213:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 0000000081344f69/0x5915dfb1c1b58f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762763.708225:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860288:0@lo:101: 00000100:00100000:1.0:1789762763.708255:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762763.708279:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccb12b0d going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.708289:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860288 00000100:00100000:0.0:1789762763.708293:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860288 00000100:00100000:0.0:1789762763.708314:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789762763.708319:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000346267fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5901:x1876702254860288:12345-0@lo:101: 00010000:00010000:0.0:1789762763.708333:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762763.708342:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b81fe260/0x5915dfb1c1b58f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58f3f expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.708357:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b81fe260/0x5915dfb1c1b58f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.708381:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b81fe260/0x5915dfb1c1b58f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762763.708390:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b81fe260, rc 0) 00000100:00100000:0.0:1789762763.708423:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000346267fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5901:x1876702254860288:12345-0@lo:101: Request processed in 104us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.708428:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789762763.708465:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860288:0@lo:101: 00010000:00010000:1.0:1789762763.708478:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 0000000081344f69/0x5915dfb1c1b58f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.708485:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 0000000081344f69/0x5915dfb1c1b58f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762763.708547:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860416:0@lo:501: 00000100:00100000:1.0:1789762763.708566:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762763.708579:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccb12b0d going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.708594:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860416 00000100:00100000:0.0:1789762763.708598:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860416 00000100:00100000:0.0:1789762763.708618:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789762763.708623:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005839a4ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5901:x1876702254860416:12345-0@lo:501: 00000100:00100000:0.0:1789762763.708678:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005839a4ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5901:x1876702254860416:12345-0@lo:501: Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.708683:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789762763.708701:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860416:0@lo:501: 00000100:00100000:1.0:1789762763.708719:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860544:0@lo:503: 00000100:00100000:1.0:1789762763.708746:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762763.708784:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccb12b0d going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.708790:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860544 00000100:00100000:0.0:1789762763.708794:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860544 00000100:00100000:0.0:1789762763.708814:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789762763.708819:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075f721b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5901:x1876702254860544:12345-0@lo:503: 00000100:00100000:0.0:1789762763.708890:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075f721b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5901:x1876702254860544:12345-0@lo:503: Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762763.708896:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4cd0757 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254860544:0@lo:503: 00000100:00100000:0.0:1789762763.708897:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789762763.709116:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a5a3966 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5951:1876702254860672:0@lo:502: 00000100:00100000:0.0:1789762763.709143:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762763.709157:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c555a2b3 going to sleep for 11 seconds 00000100:00100000:1.0:1789762763.709165:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860672 00000100:00100000:1.0:1789762763.709169:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860672 00000100:00100000:1.0:1789762763.709193:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789762763.709198:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6bdbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5951:x1876702254860672:12345-0@lo:502: 00000100:00100000:1.0:1789762763.709274:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6bdbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5951:x1876702254860672:12345-0@lo:502: Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762763.709281:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789762763.709293:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a5a3966 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5951:1876702254860672:0@lo:502: 00000020:01000004:0.0:1789762763.709337:0:5951:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789762763.709355:0:5951:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000021711bb3) 00000020:00000080:0.0:1789762763.709368:0:5951:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789762763.709429:0:5951:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000035080baf from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789762763.709432:0:5951:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000035080baf from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789762763.709435:0:5951:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000035080baf 4 00010000:00080000:0.0:1789762763.709461:0:5951:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003a0b95ef@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:0.0:1789762763.710651:0:5951:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789762763.710799:0:5951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789762763.710818:0:5951:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789762763.710836:0:5951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5915dfb1c1b58f54 00000100:00080000:0.0:1789762763.710843:0:5951:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789762763.710848:0:5951:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a0b95ef using connection 192.168.203.136@tcp/0@lo 00000100:00100000:0.0:1789762763.710872:0:5951:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006a5a3966 x1876702254860800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789762763.710893:0:5951:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789762763.710923:0:3416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a5a3966 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1876702254860800:0@lo:38: 00000100:00100000:1.0:1789762763.710958:0:3416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762763.710991:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860800 00000100:00100000:2.0:1789762763.710997:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860800 00000100:00100000:2.0:1789762763.711027:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789762763.711033:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4cd0757 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1876702254860800:12345-0@lo:38: 00000100:00100000:0.0:1789762763.711070:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024c8c961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5951:1876702254860928:0@lo:502: 00000100:00100000:2.0:1789762763.711101:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4cd0757 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1876702254860800:12345-0@lo:38: Request processed in 67us (143us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789762763.711108:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789762763.711112:0:3416:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789762763.711118:0:3416:0:(import.c:65:import_set_state_nolock()) 000000003a0b95ef lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1789762763.711119:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789762763.711125:0:3416:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789762763.711129:0:3416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a5a3966 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1876702254860800:0@lo:38: 00000100:00100000:0.0:1789762763.711144:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f266bb5a going to sleep for 11 seconds 00000100:00100000:2.0:1789762763.711149:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254860928 00000100:00100000:2.0:1789762763.711159:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254860928 00000100:00100000:2.0:1789762763.711186:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789762763.711192:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e19999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5951:x1876702254860928:12345-0@lo:502: 00000100:00100000:2.0:1789762763.711277:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e19999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5951:x1876702254860928:12345-0@lo:502: Request processed in 86us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762763.711299:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789762763.711309:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024c8c961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5951:1876702254860928:0@lo:502: 00000040:00080000:0.0:1789762763.711366:0:5951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789762763.711434:0:5901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789762763.711471:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789762763.711481:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 0000000081344f69/0x5915dfb1c1b58f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.711494:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 0000000081344f69/0x5915dfb1c1b58f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789762763.711529:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789762763.711531:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789762763.711533:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762763.711534:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762763.711535:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762763.711536:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762763.711537:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789762763.711538:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789762763.711540:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762763.711541:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762763.711542:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762763.711543:0:5901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789762763.711545:0:5901:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789762763.711547:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789762763.711548:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789762763.711549:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762763.711549:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762763.711550:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762763.711551:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762763.711551:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789762763.711552:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789762763.711553:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762763.711554:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762763.711555:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762763.711555:0:5901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789762763.711567:0:5901:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789762763.711574:0:5901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080af1f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254861056:0@lo:253: 00000100:00100000:1.0:1789762763.711604:0:5901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762763.711619:0:5901:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008e608a1 going to sleep for 11 seconds 00000100:00100000:0.0:1789762763.711639:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861056 00000100:00100000:0.0:1789762763.711643:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861056 00000100:00100000:0.0:1789762763.711677:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789762763.711683:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009029c601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5901:x1876702254861056:12345-0@lo:253: 20000000:01000000:0.0:1789762763.711698:0:5917:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789762763.711708:0:5917:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789762763.713586:0:5917:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789762763.713598:0:5917:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789762763.713616:0:5940:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789762763.713620:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789762763.713630:0:5940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.713644:0:5940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.713649:0:5940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.713668:0:5940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762763.713679:0:5940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 12 pid: 5917 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762763.713687:0:5940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d911cf33 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1876702254861184:0@lo:104: 00000100:00100000:1.0:1789762763.713715:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762763.713746:0:5940:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004158a90 going to sleep for 11 seconds 00000100:00100000:3.0:1789762763.713769:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861184 00000100:00100000:3.0:1789762763.713775:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861184 00000100:00100000:0.0:1789762763.713794:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009029c601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5901:x1876702254861056:12345-0@lo:253: Request processed in 2109us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.713804:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789762763.713806:0:5901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080af1f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5901:1876702254861056:0@lo:253: 00000100:00100000:3.0:1789762763.713815:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:1.0:1789762763.713818:0:5901:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789762763.713822:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789762763.713825:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:3.0:1789762763.713825:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003c607d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5940:x1876702254861184:12345-0@lo:104: 00000020:01000004:1.0:1789762763.713829:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762763.713833:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762763.713835:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:3.0:1789762763.713836:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789762763.713837:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762763.713840:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789762763.713844:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789762763.713847:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762763.713848:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762763.713849:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762763.713851:0:5901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789762763.713861:0:5901:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789762763.713887:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789762763.713893:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003c607d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5940:x1876702254861184:12345-0@lo:104: Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762763.713901:0:5940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d911cf33 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1876702254861184:0@lo:104: 00000100:00100000:3.0:1789762763.713901:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789762763.713941:0:5940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.713943:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762763.713951:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.713965:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc302c5f already unused, calling callback (0000000043dfb25b) 10000000:00010000:3.0:1789762763.713967:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.713973:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762763.713978:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762763.713982:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762763.714010:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714014:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762763.714030:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714035:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 00000000dc302c5f/0x5915dfb1c1b58f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f2a expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714049:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762763.714050:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762763.714052:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762763.714076:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254861312:0@lo:103: 00000100:00100000:0.0:1789762763.714106:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762763.714134:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861312 00000100:00100000:3.0:1789762763.714139:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861312 00010000:00010000:3.0:1789762763.714155:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 12 pid: 5917 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762763.714179:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789762763.714189:0:5910:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789762763.714190:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024c8c961 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3418:x1876702254861312:12345-0@lo:103: 00000100:00100000:0.0:1789762763.714198:0:5910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789762763.714201:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762763.714205:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 12 pid: 5917 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714214:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 12 pid: 5917 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714225:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000496ab646/0x5915dfb1c1b58f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58f23 expref: 12 pid: 5917 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714236:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714241:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789762763.714249:0:5909:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000629393s 00010000:00010000:3.0:1789762763.714252:0:5909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714257:0:5909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714261:0:5909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714265:0:5909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714268:0:5909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8a3d309 already unused, calling callback (000000005d1ddb1e) 00010000:00010000:3.0:1789762763.714275:0:5909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714280:0:5909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714293:0:5909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714301:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762763.714337:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024c8c961 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:3418:x1876702254861312:12345-0@lo:103: Request processed in 146us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762763.714344:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789762763.714356:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c4e3855 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254861312:0@lo:103: 00010000:00010000:3.0:1789762763.714375:0:5940:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714384:0:5940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762763.714391:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f5b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789762763.716398:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1789762763.716533:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789762763.716681:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1789762763.716838:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789762763.717006:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1789762763.717155:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789762763.717540:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1789762763.717684:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789762763.717903:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1789762763.718037:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789762763.718200:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1789762763.718331:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1789762763.719559:0:5901:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789762763.723306:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789762763.723313:0:5957:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789762763.723317:0:5957:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789762763.723475:0:5958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1789762763.724560:0:5958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789762763.725218:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789762763.725350:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789762763.730228:0:5901:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789762763.730234:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789762763.730303:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789762763.743941:0:5901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789762763.748972:0:5958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789762763.749001:0:5958:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789762763.749004:0:5958:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1789762763.749023:0:5901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789762763.749062:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789762763.749203:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789762763.749404:0:5901:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1789762763.749990:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789762763.750138:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789762763.750274:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789762763.750407:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789762763.750570:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789762763.750706:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789762763.750884:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789762763.751042:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789762763.751139:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789762763.751230:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789762763.751335:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789762763.751428:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789762763.751546:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789762763.751667:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789762763.751790:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789762763.751894:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789762763.752117:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789762763.752224:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789762763.752316:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789762763.752421:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789762763.752542:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789762763.752673:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789762763.752806:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789762763.753000:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789762763.753099:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789762763.753202:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789762763.753321:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789762763.753413:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789762763.753533:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789762763.753667:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789762763.753803:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789762763.753979:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789762763.754108:0:5901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789762763.755636:0:5901:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789762763.755651:0:5901:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb64781dd7988 00100000:10000000:2.0:1789762763.755656:0:5901:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789762763.755968:0:5901:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789762763.755978:0:5901:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789762763.755991:0:5901:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789762763.756000:0:5901:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789762763.756783:0:5901:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762763.756960:0:5901:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789762764.666917:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762765.407775:0:6202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789762765.690921:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789762765.747874:0:6254:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789762765.748012:0:6254:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789762766.714955:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789762767.481135:0:6355:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762767.481354:0:6355:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789762767.738952:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789762767.963466:0:6403:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5837f990 20000000:00000080:1.0:1789762767.963485:0:6403:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b33f44f8800 uarg=0000000000000000 20000000:01000000:1.0:1789762767.963524:0:6403:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789762767.963531:0:6403:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789762767.963536:0:6403:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789762767.963603:0:6403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789762767.963624:0:6403:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789762767.967794:0:6403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789762767.968048:0:6403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789762767.968082:0:6403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789762767.968097:0:6403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789762767.968108:0:6403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789762767.968126:0:6403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.968146:0:6403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.968154:0:6403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.968214:0:6403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.968229:0:6403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 10 pid: 5917 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762767.968245:0:6403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080af1f79 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6403:1876702254861440:0@lo:104: 00000100:00100000:1.0:1789762767.968337:0:6403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762767.968417:0:6403:0:(client.c:2715:ptlrpc_set_wait()) set 000000006eb46413 going to sleep for 11 seconds 00000100:00100000:3.0:1789762767.968437:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861440 00000100:00100000:3.0:1789762767.968473:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861440 00000100:00100000:3.0:1789762767.968544:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789762767.968552:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c5640c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:6403:x1876702254861440:12345-0@lo:104: 00010000:00010000:3.0:1789762767.968583:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762767.968679:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789762767.968686:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c5640c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:6403:x1876702254861440:12345-0@lo:104: Request processed in 133us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762767.968697:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762767.968722:0:6403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080af1f79 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6403:1876702254861440:0@lo:104: 00010000:00010000:0.0:1789762767.968740:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762767.968788:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762767.968806:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008621243c already unused, calling callback (0000000043dfb25b) 00010000:00010000:1.0:1789762767.968807:0:6403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789762767.968825:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762767.968846:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789762767.968857:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762767.968868:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789762767.968934:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762767.968947:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789762767.968981:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762767.968992:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 000000008621243c/0x5915dfb1c1b58f31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f38 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762767.969021:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762767.969024:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762767.969027:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762767.969132:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000974e9d7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254861568:0@lo:103: 00000100:00100000:3.0:1789762767.969169:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762767.969219:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861568 00000100:00100000:1.0:1789762767.969230:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861568 00010000:00010000:1.0:1789762767.969256:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 11 pid: 5917 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762767.969322:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762767.969331:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7efe7b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:3419:x1876702254861568:12345-0@lo:103: 00010000:00010000:1.0:1789762767.969346:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762767.969350:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 11 pid: 5917 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969361:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 11 pid: 5917 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969373:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000096494776/0x5915dfb1c1b58f38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58f31 expref: 11 pid: 5917 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969389:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969400:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969417:0:5911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969427:0:5911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969449:0:5911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969458:0:5911:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969476:0:5911:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8a3d309 already unused, calling callback (000000005d1ddb1e) 00010000:00010000:1.0:1789762767.969479:0:5911:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969486:0:5911:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969504:0:5911:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762767.969513:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762767.969554:0:6403:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762767.969569:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7efe7b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:3419:x1876702254861568:12345-0@lo:103: Request processed in 237us (397us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762767.969576:0:6403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762767.969582:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789762767.969609:0:6403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8a3d309/0x5915dfb1c1b58f62 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762767.969670:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000974e9d7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254861568:0@lo:103: 00010000:00010000:3.0:1789762768.762945:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789762769.211939:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789762769.211949:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1789762769.211952:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000149e5529 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254861696:0@lo:400: 00000100:00080000:2.0:1789762769.211956:0:8:0:(import.c:65:import_set_state_nolock()) 000000003a0b95ef lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789762769.211978:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a0b95ef using connection 192.168.203.136@tcp/0@lo 00000100:00100000:2.0:1789762769.212012:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc461e4d x1876702254861824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789762769.212069:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762769.212121:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861696 00000100:00100000:2.0:1789762769.212131:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861696 00000100:00100000:1.0:1789762769.212213:0:3416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc461e4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1876702254861824:0@lo:38: 00000100:00100000:2.0:1789762769.212226:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789762769.212244:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f164803d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:3420:x1876702254861696:12345-0@lo:400: 00000100:00100000:1.0:1789762769.212264:0:3416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762769.212343:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f164803d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:3420:x1876702254861696:12345-0@lo:400: Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762769.212354:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789762769.212361:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000149e5529 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254861696:0@lo:400: 00000100:00100000:2.0:1789762769.212418:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861824 00000100:00100000:2.0:1789762769.212425:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861824 00000100:00100000:2.0:1789762769.212459:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762769.212467:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080af1f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3416:x1876702254861824:12345-0@lo:38: 00010000:00080000:2.0:1789762769.212494:0:5926:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 71 last 0 00000020:00000080:2.0:1789762769.212556:0:5926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5915dfb1c1b58f69 00000004:00100000:2.0:1789762769.212604:0:5926:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789762769.212938:0:5926:0:(import.c:65:import_set_state_nolock()) 000000003bddea3e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762769.213014:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080af1f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3416:x1876702254861824:12345-0@lo:38: Request processed in 547us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762769.213039:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789762769.213969:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fc461e4d x1876702254861824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789762779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789762769.213991:0:3416:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789762769.214002:0:3416:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789762769.214008:0:3416:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789762769.214012:0:3416:0:(import.c:65:import_set_state_nolock()) 000000003a0b95ef lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789762769.214021:0:3416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc461e4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1876702254861824:0@lo:38: 00010000:00010000:0.0:1789762769.787973:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789762770.298796:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789762770.298803:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b33c8a8a800 from 3 10000000:01000000:1.0:1789762770.298808:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789762770.298849:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 00000000553be900/0x5915dfb1c1b58f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.298858:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 00000000553be900/0x5915dfb1c1b58f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.298892:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 00000000553be900/0x5915dfb1c1b58f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762770.298911:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254861952:0@lo:101: 00000100:00100000:1.0:1789762770.298965:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762770.299016:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set 000000009837997a going to sleep for 11 seconds 00000100:00100000:0.0:1789762770.299020:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254861952 00000100:00100000:0.0:1789762770.299029:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254861952 00000100:00100000:0.0:1789762770.299078:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789762770.299086:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093cb7bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:5922:x1876702254861952:12345-0@lo:101: 00010000:00010000:0.0:1789762770.299098:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762770.299108:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043860527/0x5915dfb1c1b58f77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58f70 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762770.299135:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043860527/0x5915dfb1c1b58f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762770.299143:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043860527/0x5915dfb1c1b58f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762770.299150:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043860527, rc 0) 00000100:00100000:0.0:1789762770.299186:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093cb7bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5922:x1876702254861952:12345-0@lo:101: Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762770.299192:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789762770.299226:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254861952:0@lo:101: 00010000:00010000:1.0:1789762770.299239:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 00000000553be900/0x5915dfb1c1b58f70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.299246:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 00000000553be900/0x5915dfb1c1b58f70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762770.299282:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862080:0@lo:256: 00000100:00100000:1.0:1789762770.299307:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762770.299322:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set 000000009837997a going to sleep for 11 seconds 00000100:00100000:2.0:1789762770.299352:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862080 00000100:00100000:2.0:1789762770.299359:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862080 00000100:00100000:2.0:1789762770.299387:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789762770.299392:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008908c906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5922:x1876702254862080:12345-0@lo:256: 20000000:01000000:2.0:1789762770.299405:0:5920:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789762770.299421:0:5920:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789762770.299425:0:5920:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789762770.299526:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008908c906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5922:x1876702254862080:12345-0@lo:256: Request processed in 131us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762770.299532:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862080:0@lo:256: 00000100:00100000:2.0:1789762770.299535:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:1.0:1789762770.299572:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789762770.299577:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 00000000553be900/0x5915dfb1c1b58f70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.299583:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 00000000553be900/0x5915dfb1c1b58f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762770.299589:0:5922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789762770.299590:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33c8a8a800 from 1 10000000:01000000:1.0:1789762770.299592:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789762770.299607:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000003b7658fd/0x5915dfb1c1b58f7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.299611:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 000000003b7658fd/0x5915dfb1c1b58f7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.299616:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000003b7658fd/0x5915dfb1c1b58f7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762770.299623:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862208:0@lo:101: 00000100:00100000:1.0:1789762770.299643:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762770.299657:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set 000000009837997a going to sleep for 11 seconds 00000100:00100000:0.0:1789762770.299680:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862208 00000100:00100000:0.0:1789762770.299684:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862208 00000100:00100000:0.0:1789762770.299706:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789762770.299710:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c7d2b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:5922:x1876702254862208:12345-0@lo:101: 00010000:00010000:0.0:1789762770.299716:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762770.299723:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef321370/0x5915dfb1c1b58f85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58f7e expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762770.299732:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef321370/0x5915dfb1c1b58f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762770.299738:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef321370/0x5915dfb1c1b58f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762770.299742:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef321370, rc 0) 00000100:00100000:0.0:1789762770.299793:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c7d2b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5922:x1876702254862208:12345-0@lo:101: Request processed in 83us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762770.299798:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789762770.299823:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862208:0@lo:101: 00010000:00010000:1.0:1789762770.299838:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000003b7658fd/0x5915dfb1c1b58f7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.299846:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000003b7658fd/0x5915dfb1c1b58f7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762770.299912:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862336:0@lo:501: 00000100:00100000:1.0:1789762770.299935:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762770.299960:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set 000000009837997a going to sleep for 11 seconds 00000100:00100000:2.0:1789762770.299971:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862336 00000100:00100000:2.0:1789762770.299977:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862336 00000100:00100000:2.0:1789762770.300006:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789762770.300012:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2f74e97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5922:x1876702254862336:12345-0@lo:501: 00000100:00100000:2.0:1789762770.300106:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2f74e97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5922:x1876702254862336:12345-0@lo:501: Request processed in 94us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762770.300113:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789762770.300130:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862336:0@lo:501: 00000100:00100000:1.0:1789762770.300159:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862464:0@lo:503: 00000100:00100000:1.0:1789762770.300189:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762770.300203:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set 000000009837997a going to sleep for 11 seconds 00000100:00100000:0.0:1789762770.300225:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862464 00000100:00100000:0.0:1789762770.300229:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862464 00000100:00100000:0.0:1789762770.300249:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789762770.300253:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005702f595 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5922:x1876702254862464:12345-0@lo:503: 00000100:00100000:0.0:1789762770.300323:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005702f595 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5922:x1876702254862464:12345-0@lo:503: Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762770.300329:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789762770.300352:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003558c1b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254862464:0@lo:503: 00000100:00100000:2.0:1789762770.300622:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019f28365 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6680:1876702254862592:0@lo:502: 00000100:00100000:2.0:1789762770.300654:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762770.300672:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e00c1b8 going to sleep for 11 seconds 00000100:00100000:0.0:1789762770.300692:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862592 00000100:00100000:0.0:1789762770.300696:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862592 00000100:00100000:0.0:1789762770.300716:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789762770.300720:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002abcf2fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6680:x1876702254862592:12345-0@lo:502: 00000100:00100000:0.0:1789762770.300799:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002abcf2fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6680:x1876702254862592:12345-0@lo:502: Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762770.300805:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789762770.300831:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019f28365 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6680:1876702254862592:0@lo:502: 00000020:01000000:2.0:1789762770.300855:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762770.300880:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762770.300883:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789762770.300889:0:6680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b33c8a8a800 00000020:00000080:2.0:1789762770.300891:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789762770.300924:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6680:1876702254862720:0@lo:502: 00000100:00100000:2.0:1789762770.300950:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762770.300970:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33d8ade240 going to sleep for 11 seconds 00000100:00100000:0.0:1789762770.300985:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862720 00000100:00100000:0.0:1789762770.300989:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862720 00000100:00100000:0.0:1789762770.301010:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789762770.301014:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6680:x1876702254862720:12345-0@lo:502: 00000100:00100000:0.0:1789762770.301069:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6680:x1876702254862720:12345-0@lo:502: Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762770.301074:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789762770.301102:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6680:1876702254862720:0@lo:502: 00000020:01000000:2.0:1789762770.301122:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762770.301126:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762770.301127:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789762770.301129:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789762770.301196:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789762770.301217:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789762770.301221:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762770.301228:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762770.811011:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789762771.516603:0:6903:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789762771.516606:0:6903:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789762771.516607:0:6903:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789762771.516719:0:6903:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b33f46f3000 00000020:01000004:1.0:1789762771.516732:0:6903:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789762771.516741:0:6903:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789762771.516771:0:6903:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b33f44eb370) 00000020:00000080:1.0:1789762771.516787:0:6903:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789762771.529003:0:6903:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789762771.529037:0:6903:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789762771.537343:0:6903:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789762771.537531:0:6903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789762771.537539:0:6903:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789762771.537549:0:6903:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5915dfb1c1b58f93 00000020:01000004:0.0:1789762771.537555:0:6903:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789762771.537577:0:6903:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.136@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789762771.537579:0:6903:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789762771.537584:0:6903:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789762771.537588:0:6903:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789762771.537598:0:6903:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b33f4633370) 00000020:00000080:0.0:1789762771.537610:0:6903:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1789762771.538942:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789762771.539175:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789762771.539181:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789762771.539648:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789762771.539653:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789762771.540429:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789762771.540436:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789762771.541610:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789762771.541740:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789762771.541744:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789762771.542550:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789762771.542555:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789762771.554522:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789762771.554716:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789762771.554721:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789762771.555328:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789762771.555334:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789762771.556180:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789762771.556185:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789762771.557466:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789762771.557558:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789762771.557561:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789762771.557838:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789762771.557842:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789762771.580520:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789762771.580677:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789762771.580682:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789762771.581938:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789762771.581949:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789762771.582156:0:6903:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789762771.582180:0:6903:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789762771.582185:0:6903:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789762771.589696:0:6903:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789762771.589722:0:6903:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.136@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789762771.589725:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789762771.589727:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762771.589728:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762771.589729:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762771.589730:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762771.589731:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762771.589733:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762771.589734:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762771.589735:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762771.589736:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762771.589737:0:6903:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789762771.589739:0:6903:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789762771.589740:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789762771.589741:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762771.589742:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762771.589743:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762771.589743:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762771.589744:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762771.589745:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762771.589745:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762771.589746:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762771.589747:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762771.589747:0:6903:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789762771.589788:0:6903:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789762771.589802:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254862848:0@lo:253: 00000100:00100000:1.0:1789762771.589865:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.589911:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c595fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762771.589919:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862848 00000100:00100000:0.0:1789762771.589928:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862848 00000100:00100000:0.0:1789762771.589967:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789762771.589975:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254862848:12345-0@lo:253: 20000000:01000000:0.0:1789762771.590007:0:5920:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789762771.590010:0:5920:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789762771.590014:0:5920:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789762771.590016:0:5920:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789762771.590165:0:5920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789762771.590263:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789762771.590274:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789762771.590286:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789762771.590289:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789762771.590297:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789762771.590306:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789762771.590358:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789762771.590377:0:5920:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:0.0:1789762771.590378:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1789762771.590388:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789762771.590392:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789762771.590400:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789762771.590404:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1789762771.590421:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789762771.590426:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789762771.590434:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789762771.590443:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789762771.590791:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789762771.590804:0:5920:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:0.0:1789762771.590806:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1789762771.590822:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789762771.590828:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789762771.590843:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789762771.590849:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1789762771.590879:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789762771.590884:0:5920:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789762771.590893:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789762771.590902:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789762771.590910:0:5920:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789762771.590912:0:5920:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789762771.590915:0:5920:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789762771.590945:0:5920:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789762771.590947:0:5920:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789762771.591169:0:6922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789762771.591258:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789762771.591277:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789762771.591286:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789762771.591291:0:5920:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789762771.591293:0:5920:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789762771.591508:0:6923:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789762771.591528:0:6923:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789762771.591538:0:6923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789762771.591607:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789762771.591629:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789762771.591641:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789762771.591647:0:5920:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789762771.591648:0:5920:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789762771.591802:0:6924:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789762771.591817:0:6924:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789762771.591825:0:6924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789762771.591903:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789762771.591927:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789762771.591937:0:5920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1789762771.591946:0:5920:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789762771.591961:0:5920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.591974:0:5920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b58eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.591980:0:5920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33c1662800/0x5915dfb1c1b58ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.591985:0:5920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b58f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.591990:0:5920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.592009:0:5920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b58f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.592019:0:5920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b58f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 12 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.592026:0:5920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5920:1876702254862976:0@lo:104: 00000100:00100000:0.0:1789762771.592049:0:5920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789762771.592080:0:5920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33c1662800/0x5915dfb1c1b58ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.592084:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254862976 00000100:00100000:1.0:1789762771.592089:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254862976 00010000:00010000:0.0:1789762771.592095:0:5920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33c1662800/0x5915dfb1c1b58ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 12 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.592105:0:5920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5920:1876702254863104:0@lo:104: 00000100:00100000:1.0:1789762771.592121:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789762771.592126:0:5920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.592131:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5920:x1876702254862976:12345-0@lo:104: 00010000:00010000:0.0:1789762771.592142:0:5920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b58eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.592149:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.592150:0:5920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b58eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 12 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.592173:0:5920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5920:1876702254863232:0@lo:104: 00000100:00100000:3.0:1789762771.592182:0:5907:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789762771.592191:0:5907:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1789762771.592205:0:5920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762771.592217:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789762771.592218:0:5920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e0f58900 going to sleep for 11 seconds 00000100:00100000:1.0:1789762771.592226:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5920:x1876702254862976:12345-0@lo:104: Request processed in 97us (175us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762771.592229:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789762771.592233:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789762771.592236:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.592239:0:5920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5920:1876702254862976:0@lo:104: 00000100:00100000:1.0:1789762771.592250:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254863104 00000100:00100000:1.0:1789762771.592254:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254863104 00010000:00010000:3.0:1789762771.592267:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc1490c20) 00000100:00100000:1.0:1789762771.592270:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254863232 00000100:00100000:1.0:1789762771.592273:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254863232 10000000:00010000:3.0:1789762771.592273:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.592286:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.592293:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789762771.592303:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5920:x1876702254863104:12345-0@lo:104: 10000000:00010000:3.0:1789762771.592303:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.592314:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762771.592315:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789762771.592362:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789762771.592362:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.592372:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5920:x1876702254863104:12345-0@lo:104: Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762771.592374:0:5920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5920:1876702254863104:0@lo:104: 00010000:00010000:3.0:1789762771.592378:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789762771.592387:0:6925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789762771.592395:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789762771.592399:0:6925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5920:x1876702254863232:12345-0@lo:104: 00010000:00010000:3.0:1789762771.592400:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.592411:0:6925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.592414:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789762771.592414:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c1663e00/0x5915dfb1c1b58f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f46 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.592417:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789762771.592428:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254863360:0@lo:103: 00010000:00010000:3.0:1789762771.592446:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762771.592451:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762771.592454:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762771.592462:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.592492:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254863360 00000100:00100000:1.0:1789762771.592497:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254863360 00010000:00010000:1.0:1789762771.592516:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b58f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 13 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.592525:0:6925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789762771.592527:0:5920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5920:1876702254863232:0@lo:104: 00010000:00010000:2.0:1789762771.592535:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789762771.592537:0:6925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5920:x1876702254863232:12345-0@lo:104: Request processed in 139us (328us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762771.592542:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.592547:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789762771.592551:0:5920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762771.592553:0:6925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789762771.592558:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6400 already unused, calling callback (ffffffffc1490c20) 00000100:00100000:1.0:1789762771.592562:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3418:x1876702254863360:12345-0@lo:103: 10000000:00010000:2.0:1789762771.592565:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.592577:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.592579:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762771.592597:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b58f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 13 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762771.592597:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762771.592616:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789762771.592620:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b58f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 13 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.592623:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762771.592632:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762771.592635:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762771.592637:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b58f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58f3f expref: 13 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.592639:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.592642:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.592658:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762771.592660:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7a00 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:2.0:1789762771.592663:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789762771.592671:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.592678:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.592683:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789762771.592685:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.592690:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3418:x1876702254863360:12345-0@lo:103: Request processed in 130us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.592701:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254863488:0@lo:103: 10000000:01000000:0.0:1789762771.592708:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762771.592709:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b58eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58eba expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.592715:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789762771.592730:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762771.592733:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762771.592736:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762771.592740:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762771.592740:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789762771.592747:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789762771.592792:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.592800:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254863488 00010000:00010000:0.0:1789762771.592801:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b34021f7a00/0x5915dfb1c1b58ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58ed6 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762771.592804:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254863360:0@lo:103: 00000100:00100000:1.0:1789762771.592807:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254863488 00000100:00100000:2.0:1789762771.592814:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254863616:0@lo:103: 00010000:00010000:1.0:1789762771.592830:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b58eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 12 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.592835:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762771.592841:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762771.592846:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762771.592850:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.592875:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254863616 00000100:00100000:1.0:1789762771.592881:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254863616 00000100:00100000:3.0:1789762771.592895:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789762771.592899:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33c1662800/0x5915dfb1c1b58ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 13 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762771.592911:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3418:x1876702254863488:12345-0@lo:103: 00000100:00100000:2.0:1789762771.592916:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789762771.592924:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762771.592929:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3419:x1876702254863616:12345-0@lo:103: 00010000:00010000:3.0:1789762771.592934:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b58eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.592939:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762771.592945:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b58eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.592946:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33c1662800/0x5915dfb1c1b58ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 13 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.592969:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b58eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58eb3 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.592972:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33c1662800/0x5915dfb1c1b58ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 13 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.592995:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762771.593002:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c1662800/0x5915dfb1c1b58ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58ecf expref: 12 pid: 5920 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.593014:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.593020:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762771.593029:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:3418:x1876702254863488:12345-0@lo:103: Request processed in 124us (292us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762771.593030:0:5909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762771.593043:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789762771.593044:0:5909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.593050:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254863488:0@lo:103: 00010000:00010000:2.0:1789762771.593057:0:5909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.593063:0:5909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.593067:0:5909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762771.593070:0:5909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.593075:0:5909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.593087:0:5909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.593095:0:5920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.593112:0:5920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.593113:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762771.593120:0:5920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cef800/0x5915dfb1c1b58fa1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789762771.593138:0:5920:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789762771.593150:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:3419:x1876702254863616:12345-0@lo:103: Request processed in 225us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.593157:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789762771.593179:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254863616:0@lo:103: 00000100:00100000:0.0:1789762771.594284:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:6903:x1876702254862848:12345-0@lo:253: Request processed in 4309us (4429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762771.594290:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789762771.594302:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254862848:0@lo:253: 10000000:01000000:1.0:1789762771.594313:0:6903:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789762771.594315:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789762771.594316:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762771.594317:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762771.594318:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789762771.594319:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762771.594320:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762771.594321:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762771.594322:0:6903:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789762771.594328:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762771.594329:0:6903:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789762771.594341:0:6903:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b33f46f3000 from lustre-OST0000 10000000:01000000:1.0:1789762771.594355:0:6903:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789762771.594357:0:6903:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789762771.594361:0:6903:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b33d8ce99b8 local copy 10000000:01000000:1.0:1789762771.594364:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789762771.594377:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594384:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594390:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.594398:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254863744:0@lo:101: 00000100:00100000:1.0:1789762771.594423:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.594450:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c595f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762771.594458:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254863744 00000100:00100000:0.0:1789762771.594464:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254863744 00000100:00100000:0.0:1789762771.594495:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789762771.594503:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+9:6903:x1876702254863744:12345-0@lo:101: 00010000:00010000:0.0:1789762771.594511:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762771.594524:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b58faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58fa8 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.594540:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b58faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fa8 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.594551:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b58faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fa8 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.594557:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef600, rc 0) 00000100:00100000:0.0:1789762771.594586:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:6903:x1876702254863744:12345-0@lo:101: Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762771.594591:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789762771.594612:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254863744:0@lo:101: 00010000:00010000:1.0:1789762771.594623:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594630:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.594681:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254863872:0@lo:501: 00000100:00100000:1.0:1789762771.594700:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.594714:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c595f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762771.594727:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254863872 00000100:00100000:0.0:1789762771.594731:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254863872 00000100:00100000:0.0:1789762771.594775:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789762771.594782:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:6903:x1876702254863872:12345-0@lo:501: 00000100:00100000:0.0:1789762771.594842:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:6903:x1876702254863872:12345-0@lo:501: Request processed in 60us (139us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789762771.594861:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254863872:0@lo:501: 00000100:00100000:0.0:1789762771.594867:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 10000000:01000000:1.0:1789762771.594886:0:6903:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789762771.594900:0:6903:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789762771.594904:0:6903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594910:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594914:0:6903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594926:0:6903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789762771.594938:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b33f46f3000 10000000:01000000:1.0:1789762771.594941:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789762771.594944:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b33d8ce99b8 10000000:01000000:1.0:1789762771.594946:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789762771.594947:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1789762771.594948:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b33d8ce99b8 from 1 10000000:01000000:1.0:1789762771.594952:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789762771.594954:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.594962:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663400 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:1.0:1789762771.594964:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1662400/0x5915dfb1c1b58fb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762771.594966:0:6926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594972:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c1662400/0x5915dfb1c1b58fb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.594993:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c1662400/0x5915dfb1c1b58fb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.594994:0:6926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762771.595008:0:6926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.595012:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864000:0@lo:101: 10000000:01000000:3.0:1789762771.595015:0:6926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762771.595032:0:6926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.595036:0:6926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789762771.595041:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762771.595056:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.595062:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b58fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5915dfb1c1b58faf expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.595063:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254864128:0@lo:103: 00000100:00100000:1.0:1789762771.595068:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c595f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789762771.595086:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864000 00010000:00010000:3.0:1789762771.595088:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762771.595091:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762771.595092:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864000 00010000:00010000:3.0:1789762771.595095:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762771.595100:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.595128:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864128 00000100:00100000:2.0:1789762771.595133:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789762771.595134:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864128 00000100:00100000:2.0:1789762771.595142:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864000:12345-0@lo:101: 00010000:00010000:2.0:1789762771.595150:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762771.595160:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c0030a00/0x5915dfb1c1b58fbd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58fb6 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.595170:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789762771.595177:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c0030a00/0x5915dfb1c1b58fbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fb6 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762771.595181:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3420:x1876702254864128:12345-0@lo:103: 00010000:00010000:1.0:1789762771.595193:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762771.595197:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c0030a00/0x5915dfb1c1b58fbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fb6 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.595204:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b58faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5915dfb1c1b58fa8 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.595211:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0030a00, rc 0) 00010000:00010000:1.0:1789762771.595216:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762771.595256:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:3420:x1876702254864128:12345-0@lo:103: Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762771.595262:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789762771.595268:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254864128:0@lo:103: 00000100:00100000:2.0:1789762771.595274:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:6903:x1876702254864000:12345-0@lo:101: Request processed in 130us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.595282:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789762771.595303:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864000:0@lo:101: 00010000:00010000:0.0:1789762771.595313:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c1662400/0x5915dfb1c1b58fb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fbd expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.595320:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c1662400/0x5915dfb1c1b58fb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58fbd expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762771.595330:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789762771.595340:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1662400/0x5915dfb1c1b58fb6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fbd expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.595345:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c1662400/0x5915dfb1c1b58fb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fbd expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762771.595350:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789762771.595353:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789762771.595357:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789762771.595358:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789762771.595369:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.595375:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.595389:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.595399:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864256:0@lo:101: 00000100:00100000:0.0:1789762771.595418:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.595433:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762771.595448:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864256 00000100:00100000:2.0:1789762771.595453:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864256 00000100:00100000:2.0:1789762771.595474:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789762771.595479:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+10:6903:x1876702254864256:12345-0@lo:101: 00010000:00010000:2.0:1789762771.595484:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762771.595497:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58fc4 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.595508:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 11 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.595514:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 11 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.595519:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0031800, rc 0) 00000100:00100000:2.0:1789762771.595547:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864256:12345-0@lo:101: Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.595552:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789762771.595563:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864256:0@lo:101: 00010000:00010000:0.0:1789762771.595577:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.595583:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.595620:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864384:0@lo:501: 00000100:00100000:0.0:1789762771.595638:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.595651:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762771.595665:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864384 00000100:00100000:2.0:1789762771.595670:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864384 00000100:00100000:2.0:1789762771.595691:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789762771.595695:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864384:12345-0@lo:501: 00000100:00100000:0.0:1789762771.595801:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864384:0@lo:501: 00000100:00100000:2.0:1789762771.595828:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864384:12345-0@lo:501: Request processed in 131us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.595837:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789762771.595838:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864512:0@lo:503: 00000100:00100000:0.0:1789762771.595884:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762771.595905:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864512 00000100:00100000:0.0:1789762771.595908:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762771.595910:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864512 00000100:00100000:2.0:1789762771.595935:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789762771.595939:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864512:12345-0@lo:503: 00000100:00100000:2.0:1789762771.595998:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864512:12345-0@lo:503: Request processed in 58us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.596005:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789762771.596020:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864512:0@lo:503: 00000040:00080000:0.0:1789762771.596123:0:6903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789762771.596166:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864640:0@lo:502: 00000100:00100000:0.0:1789762771.596191:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.596205:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762771.596225:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864640 00000100:00100000:2.0:1789762771.596230:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864640 00000100:00100000:2.0:1789762771.596258:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789762771.596262:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864640:12345-0@lo:502: 00000100:00100000:2.0:1789762771.596319:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864640:12345-0@lo:502: Request processed in 56us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.596325:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789762771.596340:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864640:0@lo:502: 00000040:00080000:0.0:1789762771.596437:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789762771.596453:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789762771.596461:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789762771.596469:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789762771.596476:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789762771.596483:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789762771.596496:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864768:0@lo:502: 00000100:00100000:0.0:1789762771.596521:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.596536:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762771.596548:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864768 00000100:00100000:2.0:1789762771.596553:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864768 00000100:00100000:2.0:1789762771.596573:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789762771.596577:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864768:12345-0@lo:502: 00000100:00100000:2.0:1789762771.596630:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864768:12345-0@lo:502: Request processed in 52us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.596637:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789762771.596651:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864768:0@lo:502: 00000040:00080000:0.0:1789762771.596683:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789762771.596688:0:6903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789762771.596910:0:6927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789762771.596915:0:6927:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789762771.596920:0:6927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762771.596922:0:6927:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789762771.596926:0:6927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789762771.596935:0:6927:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b33e0a319b8) 00000020:00000080:3.0:1789762771.596948:0:6927:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789762771.596951:0:6927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789762771.596994:0:6927:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b33f46f3000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789762771.596999:0:6927:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789762771.597006:0:6927:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5915dfb1c1b58fd9 00010000:00010000:3.0:1789762771.599635:0:6927:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789762771.599768:0:6927:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789762771.601466:0:6927:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789762771.601606:0:6927:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789762771.605179:0:6927:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789762771.605324:0:6927:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789762771.608081:0:6927:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789762771.608660:0:6927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789762771.608665:0:6927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762771.608668:0:6927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762771.608670:0:6927:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789762771.608672:0:6927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789762771.608675:0:6927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762771.608676:0:6927:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789762771.608678:0:6927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789762771.608680:0:6927:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789762771.608688:0:6927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762771.608690:0:6927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762771.608691:0:6927:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789762771.608692:0:6927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789762771.608785:0:6903:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789762771.608818:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789762771.608838:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.608850:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762771.608868:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33f46f3000 from 1 10000000:01000000:0.0:1789762771.608871:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789762771.608889:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.608895:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.608901:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.608919:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864896:0@lo:101: 00000100:00100000:0.0:1789762771.608950:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762771.608978:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254864896 00000100:00100000:0.0:1789762771.608981:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.608983:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254864896 00000100:00100000:3.0:1789762771.609018:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789762771.609025:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:6903:x1876702254864896:12345-0@lo:101: 00010000:00010000:3.0:1789762771.609032:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762771.609039:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58fe0 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.609052:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.609070:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.609075:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7800, rc 0) 00000100:00100000:3.0:1789762771.609110:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254864896:12345-0@lo:101: Request processed in 86us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.609116:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789762771.609143:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254864896:0@lo:101: 00010000:00010000:0.0:1789762771.609155:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.609161:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.609214:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865024:0@lo:501: 00000100:00100000:0.0:1789762771.609242:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.609259:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.609270:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865024 00000100:00100000:3.0:1789762771.609276:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865024 00000100:00100000:3.0:1789762771.609309:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789762771.609318:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865024:12345-0@lo:501: 00000100:00100000:3.0:1789762771.609398:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865024:12345-0@lo:501: Request processed in 81us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.609404:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789762771.609425:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865024:0@lo:501: 00000100:00100000:0.0:1789762771.609451:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865152:0@lo:503: 00000100:00100000:0.0:1789762771.609489:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.609503:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.609515:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865152 00000100:00100000:3.0:1789762771.609521:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865152 00000100:00100000:3.0:1789762771.609553:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789762771.609559:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865152:12345-0@lo:503: 00000100:00100000:3.0:1789762771.609626:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865152:12345-0@lo:503: Request processed in 67us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.609631:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789762771.609657:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865152:0@lo:503: 00000040:00080000:0.0:1789762771.609805:0:6903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789762771.609848:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865280:0@lo:502: 00000100:00100000:0.0:1789762771.609894:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.609919:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.609919:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865280 00000100:00100000:3.0:1789762771.609925:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865280 00000100:00100000:3.0:1789762771.609956:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789762771.609962:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865280:12345-0@lo:502: 00000100:00100000:3.0:1789762771.610024:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865280:12345-0@lo:502: Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.610035:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789762771.610038:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865280:0@lo:502: 00000040:00080000:0.0:1789762771.610166:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789762771.610190:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789762771.610207:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865408:0@lo:502: 00000100:00100000:0.0:1789762771.610240:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.610260:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.610274:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865408 00000100:00100000:3.0:1789762771.610280:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865408 00000100:00100000:3.0:1789762771.610308:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789762771.610314:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865408:12345-0@lo:502: 00000100:00100000:3.0:1789762771.610387:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865408:12345-0@lo:502: Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.610393:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789762771.610400:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865408:0@lo:502: 00000040:00080000:0.0:1789762771.610435:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789762771.610440:0:6903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789762771.610690:0:6931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789762771.610695:0:6931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762771.610697:0:6931:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789762771.610702:0:6931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b33f46f3000 00000020:00000080:3.0:1789762771.610705:0:6931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789762771.610713:0:6931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762771.610715:0:6931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762771.610716:0:6931:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789762771.610718:0:6931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789762771.610772:0:6903:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789762771.610799:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789762771.610815:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.610825:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762771.610871:0:6903:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789762771.610873:0:6903:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b33f46f3000 10000000:01000000:0.0:1789762771.610875:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b33f46f3000 10000000:01000000:0.0:1789762771.610879:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789762771.610882:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33f46f3000 from 1 10000000:01000000:0.0:1789762771.610884:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789762771.610898:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.610903:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.610909:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.610927:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865536:0@lo:101: 00000100:00100000:0.0:1789762771.610953:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762771.610977:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865536 00000100:00100000:3.0:1789762771.610981:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865536 00000100:00100000:0.0:1789762771.610984:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.611007:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789762771.611014:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:6903:x1876702254865536:12345-0@lo:101: 00010000:00010000:3.0:1789762771.611019:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762771.611026:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b58fee expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.611037:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 13 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.611043:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 13 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.611054:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f6000, rc 0) 00000100:00100000:3.0:1789762771.611084:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254865536:12345-0@lo:101: Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.611090:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789762771.611101:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865536:0@lo:101: 00010000:00010000:0.0:1789762771.611115:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.611121:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.611159:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865664:0@lo:501: 00000100:00100000:0.0:1789762771.611181:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.611196:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.611203:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865664 00000100:00100000:3.0:1789762771.611206:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865664 00000100:00100000:3.0:1789762771.611230:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789762771.611236:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254865664:12345-0@lo:501: 00000100:00100000:3.0:1789762771.611313:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254865664:12345-0@lo:501: Request processed in 78us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.611321:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789762771.611325:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865664:0@lo:501: 00000100:00100000:0.0:1789762771.611348:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865792:0@lo:503: 00000100:00100000:0.0:1789762771.611376:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.611391:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.611398:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865792 00000100:00100000:3.0:1789762771.611403:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865792 00000100:00100000:3.0:1789762771.611434:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789762771.611442:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254865792:12345-0@lo:503: 00000100:00100000:3.0:1789762771.611508:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254865792:12345-0@lo:503: Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.611516:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789762771.611518:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865792:0@lo:503: 00000040:00080000:0.0:1789762771.611631:0:6903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789762771.611662:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865920:0@lo:502: 00000100:00100000:0.0:1789762771.611692:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.611709:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.611713:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254865920 00000100:00100000:3.0:1789762771.611718:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254865920 00000100:00100000:3.0:1789762771.611740:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789762771.611746:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254865920:12345-0@lo:502: 00000100:00100000:3.0:1789762771.611829:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254865920:12345-0@lo:502: Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.611834:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789762771.611872:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254865920:0@lo:502: 00000040:00080000:0.0:1789762771.612010:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789762771.612037:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789762771.612048:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789762771.612057:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789762771.612067:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789762771.612077:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789762771.612086:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789762771.612096:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789762771.612104:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789762771.612124:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789762771.612136:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789762771.612146:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789762771.612156:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789762771.612167:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789762771.612177:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789762771.612186:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789762771.612196:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789762771.612204:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789762771.612215:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789762771.612225:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789762771.612235:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789762771.612245:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789762771.612259:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789762771.612276:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789762771.612293:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789762771.612321:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789762771.612339:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789762771.612356:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789762771.612376:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254866048:0@lo:502: 00000100:00100000:0.0:1789762771.612408:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762771.612431:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762771.612445:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866048 00000100:00100000:3.0:1789762771.612455:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866048 00000100:00100000:3.0:1789762771.612478:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789762771.612483:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254866048:12345-0@lo:502: 00000100:00100000:3.0:1789762771.612564:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254866048:12345-0@lo:502: Request processed in 80us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762771.612570:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789762771.612577:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254866048:0@lo:502: 00000040:00080000:0.0:1789762771.612618:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789762771.612630:0:6903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789762771.612895:0:6932:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789762771.612904:0:6932:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b33f46319b8) 00000020:00000080:0.0:1789762771.612913:0:6932:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789762771.612966:0:6932:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b33f46f3000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789762771.612969:0:6932:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b33f46f3000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789762771.612971:0:6932:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b33f46f3000 3 00010000:00080000:0.0:1789762771.612993:0:6932:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b33fe87a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.136@tcp at head 00010000:00010000:0.0:1789762771.614542:0:6932:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789762771.614661:0:6932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789762771.614679:0:6932:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789762771.614686:0:6932:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5915dfb1c1b59003 00000100:00080000:0.0:1789762771.614693:0:6932:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789762771.614697:0:6932:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b33fe87a800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:0.0:1789762771.614714:0:6932:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b33f453e300 x1876702254866176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789762771.614732:0:6932:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789762771.614784:0:3416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1876702254866176:0@lo:38: 00000100:00100000:3.0:1789762771.614822:0:3416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.614838:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762771.614850:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254866304:0@lo:400: 00000100:00100000:1.0:1789762771.614896:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789762771.614911:0:6932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1789762771.614928:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866176 00000100:00100000:3.0:1789762771.614933:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866176 00000020:01000000:1.0:1789762771.614954:0:6903:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:3.0:1789762771.614957:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866304 00000100:00100000:3.0:1789762771.614960:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866304 10000000:01000000:1.0:1789762771.614985:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1789762771.614991:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789762771.614999:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254866304:12345-0@lo:400: 00010000:00010000:1.0:1789762771.615000:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762771.615010:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789762771.615043:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789762771.615045:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762771.615049:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:3.0:1789762771.615049:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254866304:12345-0@lo:400: Request processed in 51us (153us total) trans 0 rc 0/0 00000020:01000004:1.0:1789762771.615051:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762771.615054:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762771.615058:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762771.615060:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:3.0:1789762771.615061:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789762771.615065:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b340041bb80 x1876702254866304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1789762771.615068:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762771.615071:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762771.615074:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762771.615079:0:6903:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1789762771.615079:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789762771.615083:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254866304:0@lo:400: 10000000:01000000:1.0:1789762771.615084:0:6903:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000100:00100000:3.0:1789762771.615088:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1876702254866176:12345-0@lo:38: 00000020:01000004:1.0:1789762771.615091:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789762771.615094:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762771.615095:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762771.615096:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762771.615097:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762771.615098:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762771.615100:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762771.615101:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762771.615101:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762771.615102:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762771.615104:0:6903:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:3.0:1789762771.615107:0:5924:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 74 last 0 10000000:01000000:1.0:1789762771.615117:0:6903:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789762771.615126:0:6903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254866432:0@lo:253: 00000020:00000080:3.0:1789762771.615143:0:5924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5915dfb1c1b5900a 00000004:00100000:3.0:1789762771.615157:0:5924:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1789762771.615164:0:6903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762771.615180:0:6903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c595f540 going to sleep for 11 seconds 00000100:00080000:3.0:1789762771.615182:0:5924:0:(import.c:65:import_set_state_nolock()) ffff9b33fe881800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762771.615198:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866432 00000100:00100000:1.0:1789762771.615202:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866432 00000100:00100000:3.0:1789762771.615226:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3416:x1876702254866176:12345-0@lo:38: Request processed in 140us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762771.615238:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789762771.615238:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789762771.615245:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b33f453e300 x1876702254866176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789762781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762771.615254:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254866432:12345-0@lo:253: 00000100:00100000:0.0:1789762771.615255:0:3416:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789762771.615263:0:3416:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789762771.615269:0:3416:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789762771.615273:0:3416:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 20000000:01000000:1.0:1789762771.615273:0:5917:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:0.0:1789762771.615282:0:3416:0:(import.c:65:import_set_state_nolock()) ffff9b33fe87a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 20000000:01000000:1.0:1789762771.615285:0:5917:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789762771.615289:0:3416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1876702254866176:0@lo:38: 20000000:01000000:3.0:1789762771.617296:0:5917:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789762771.617312:0:5917:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789762771.617362:0:5940:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789762771.617366:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789762771.617378:0:5940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.617389:0:5940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cefa00/0x5915dfb1c1b58f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.617394:0:5940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.617413:0:5940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cefa00/0x5915dfb1c1b58f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.617424:0:5940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cefa00/0x5915dfb1c1b58f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.617433:0:5940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1876702254866560:0@lo:104: 00000100:00100000:0.0:1789762771.617464:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762771.617503:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:6903:x1876702254866432:12345-0@lo:253: Request processed in 2249us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.617506:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866560 00000100:00100000:0.0:1789762771.617509:0:5940:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e06b8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789762771.617511:0:6903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:6903:1876702254866432:0@lo:253: 00000100:00100000:2.0:1789762771.617514:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866560 00000100:00100000:3.0:1789762771.617519:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 10000000:01000000:1.0:1789762771.617524:0:6903:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789762771.617527:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789762771.617528:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789762771.617529:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762771.617531:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762771.617532:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762771.617533:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762771.617534:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762771.617540:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762771.617541:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762771.617543:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762771.617544:0:6903:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789762771.617554:0:6903:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789762771.617560:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789762771.617569:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5940:x1876702254866560:12345-0@lo:104: 00010000:00010000:2.0:1789762771.617578:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617619:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789762771.617624:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5940:x1876702254866560:12345-0@lo:104: Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762771.617630:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789762771.617634:0:5940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1876702254866560:0@lo:104: 00010000:00010000:3.0:1789762771.617640:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762771.617647:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.617651:0:5940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.617656:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662a00 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:3.0:1789762771.617661:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.617668:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762771.617673:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762771.617676:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762771.617697:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.617701:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762771.617713:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762771.617716:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254866688:0@lo:103: 00010000:00010000:3.0:1789762771.617722:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c1662a00/0x5915dfb1c1b58f70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f77 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762771.617736:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762771.617737:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762771.617745:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762771.617746:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762771.617782:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866688 00000100:00100000:2.0:1789762771.617786:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866688 00010000:00010000:2.0:1789762771.617802:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cefa00/0x5915dfb1c1b58f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762771.617823:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789762771.617836:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3418:x1876702254866688:12345-0@lo:103: 00010000:00010000:2.0:1789762771.617843:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762771.617847:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cefa00/0x5915dfb1c1b58f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617866:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cefa00/0x5915dfb1c1b58f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617876:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cefa00/0x5915dfb1c1b58f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58f70 expref: 13 pid: 5917 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617883:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617888:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789762771.617896:0:5911:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000629393s 00010000:00010000:2.0:1789762771.617899:0:5911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617903:0:5911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617908:0:5911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617912:0:5911:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617915:0:5911:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762771.617922:0:5911:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617927:0:5911:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617939:0:5911:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762771.617946:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762771.617959:0:5940:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762771.617973:0:5940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762771.617975:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3418:x1876702254866688:12345-0@lo:103: Request processed in 139us (230us total) trans 0 rc 0/0 00010000:00010000:0.0:1789762771.617986:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59011 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762771.617991:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789762771.618004:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254866688:0@lo:103: 00080000:10000000:1.0:1789762771.620051:0:6903:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789762771.620161:0:6903:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789762771.620281:0:6903:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789762771.620381:0:6903:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789762771.620507:0:6903:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789762771.620618:0:6903:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789762771.621192:0:6903:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789762771.624569:0:6903:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789762771.624573:0:6903:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789762771.624589:0:6903:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789762771.624607:0:6903:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789762771.624617:0:6903:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789762771.624625:0:6903:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789762771.625343:0:6903:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762771.625482:0:6903:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789762771.834876:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789762771.903299:0:6986:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789762771.903421:0:6986:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789762772.858976:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789762773.623443:0:7275:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789762773.883953:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789762773.928112:0:7327:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762773.928232:0:7327:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789762774.907001:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789762775.570109:0:7428:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789762775.570243:0:7428:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1789762775.918116:0:7476:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789762775.918130:0:7476:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789762775.932017:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762776.890973:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254866816:0@lo:400: 00000100:00100000:0.0:1789762776.890984:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789762776.891006:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254867072:0@lo:400: 00000100:00100000:1.0:1789762776.891007:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254866944:0@lo:400: 00000100:00100000:2.0:1789762776.891040:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762776.891061:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762776.891120:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867072 00000100:00100000:2.0:1789762776.891120:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866816 00000100:00100000:0.0:1789762776.891129:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867072 00000100:00100000:2.0:1789762776.891129:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866816 00000100:00100000:1.0:1789762776.891144:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762776.891182:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789762776.891191:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3419:x1876702254866816:12345-0@lo:400: 00000100:00100000:0.0:1789762776.891213:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254866944 00000100:00100000:0.0:1789762776.891219:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254866944 00000100:00100000:2.0:1789762776.891262:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3419:x1876702254866816:12345-0@lo:400: Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762776.891269:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762776.891274:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789762776.891282:0:5925:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789762776.891285:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254867072:12345-0@lo:400: 00000100:00100000:1.0:1789762776.891297:0:5925:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789762776.891336:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254866816:0@lo:400: 00000100:00100000:0.0:1789762776.891363:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254867072:12345-0@lo:400: Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762776.891372:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789762776.891374:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762776.891407:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789762776.891431:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254866944:12345-0@lo:400: 00010000:00080000:0.0:1789762776.891447:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33f453df80 x1876702254867072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762776.891459:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254867072:0@lo:400: 00000100:00080000:2.0:1789762776.891464:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762776.891554:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254866944:12345-0@lo:400: Request processed in 125us (414us total) trans 0 rc 0/0 00010000:00080000:0.0:1789762776.891565:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33f453c700 x1876702254866944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762776.891579:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789762776.891585:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254866944:0@lo:400: 00010000:00010000:2.0:1789762776.954876:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762777.988545:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789762778.939792:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789762778.939809:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33c8a8a800 from 21 10000000:01000000:3.0:1789762778.939813:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789762778.939850:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.939859:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.939868:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762778.939885:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867200:0@lo:101: 00000100:00100000:3.0:1789762778.939940:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762778.939977:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867200 00000100:00100000:3.0:1789762778.939983:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.939985:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867200 00000100:00100000:1.0:1789762778.940029:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789762778.940040:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5922:x1876702254867200:12345-0@lo:101: 00010000:00010000:1.0:1789762778.940052:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762778.940063:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59018 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762778.940082:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762778.940090:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762778.940098:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663400, rc 0) 00000100:00100000:1.0:1789762778.940135:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254867200:12345-0@lo:101: Request processed in 98us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.940141:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789762778.940166:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867200:0@lo:101: 00010000:00010000:3.0:1789762778.940180:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.940187:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762778.940232:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867328:0@lo:501: 00000100:00100000:3.0:1789762778.940251:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.940269:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762778.940328:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867328 00000100:00100000:2.0:1789762778.940334:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867328 00000100:00100000:2.0:1789762778.940364:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789762778.940372:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254867328:12345-0@lo:501: 00000100:00100000:2.0:1789762778.940474:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254867328:12345-0@lo:501: Request processed in 104us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.940481:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789762778.940495:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867328:0@lo:501: 00000100:00100000:3.0:1789762778.940525:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867456:0@lo:503: 00000100:00100000:3.0:1789762778.940563:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.940581:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.940598:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867456 00000100:00100000:1.0:1789762778.940603:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867456 00000100:00100000:1.0:1789762778.940634:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789762778.940642:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254867456:12345-0@lo:503: 00000100:00100000:1.0:1789762778.940720:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254867456:12345-0@lo:503: Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.940727:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789762778.940730:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867456:0@lo:503: 00000100:00100000:3.0:1789762778.941129:0:7947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7947:1876702254867584:0@lo:502: 00000100:00100000:3.0:1789762778.941164:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762778.941194:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867584 00000100:00100000:3.0:1789762778.941197:0:7947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762778.941201:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867584 00000100:00100000:2.0:1789762778.941234:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789762778.941242:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7947:x1876702254867584:12345-0@lo:502: 00000100:00100000:2.0:1789762778.941330:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7947:x1876702254867584:12345-0@lo:502: Request processed in 89us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.941337:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789762778.941344:0:7947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7947:1876702254867584:0@lo:502: 00000100:00100000:3.0:1789762778.941401:0:7947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7947:1876702254867712:0@lo:502: 00000100:00100000:3.0:1789762778.941442:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.941459:0:7947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762778.941476:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867712 00000100:00100000:0.0:1789762778.941482:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867712 00000100:00100000:0.0:1789762778.941510:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789762778.941520:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7947:x1876702254867712:12345-0@lo:502: 00000100:00100000:0.0:1789762778.941597:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7947:x1876702254867712:12345-0@lo:502: Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762778.941604:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789762778.941607:0:7947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7947:1876702254867712:0@lo:502: 00000040:00080000:3.0:1789762778.941632:0:7947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789762778.941691:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789762778.941715:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789762778.941721:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.941729:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762778.941735:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789762778.941737:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b33c8a8a800 from 4 10000000:01000000:2.0:1789762778.941739:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789762778.941775:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.941781:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.941793:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.941816:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867840:0@lo:101: 00000100:00100000:2.0:1789762778.941842:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.941869:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867840 00000100:00100000:2.0:1789762778.941872:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762778.941874:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867840 00000100:00100000:3.0:1789762778.941903:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789762778.941909:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254867840:12345-0@lo:101: 00010000:00010000:3.0:1789762778.941916:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762778.941925:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59026 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.941936:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.941943:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.941955:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7000, rc 0) 00000100:00100000:3.0:1789762778.941989:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254867840:12345-0@lo:101: Request processed in 80us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762778.941994:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789762778.941998:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867840:0@lo:101: 00010000:00010000:2.0:1789762778.942010:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.942017:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.942057:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867968:0@lo:256: 00000100:00100000:2.0:1789762778.942086:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762778.942101:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca240 going to sleep for 11 seconds 00000100:00100000:0.0:1789762778.942116:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254867968 00000100:00100000:0.0:1789762778.942121:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254867968 00000100:00100000:0.0:1789762778.942146:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789762778.942154:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254867968:12345-0@lo:256: 20000000:01000000:0.0:1789762778.942166:0:5917:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789762778.942180:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789762778.942182:0:5917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789762778.942276:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254867968:12345-0@lo:256: Request processed in 123us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.942282:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254867968:0@lo:256: 00000100:00100000:0.0:1789762778.942286:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 10000000:01000000:2.0:1789762778.942320:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789762778.942325:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.942330:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762778.942335:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789762778.942336:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789762778.942343:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789762778.942355:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.942360:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.942365:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.942373:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254868096:0@lo:101: 00000100:00100000:2.0:1789762778.942397:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762778.942412:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762778.942430:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868096 00000100:00100000:3.0:1789762778.942435:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868096 00000100:00100000:3.0:1789762778.942462:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789762778.942468:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254868096:12345-0@lo:101: 00010000:00010000:3.0:1789762778.942474:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762778.942481:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59034 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.942492:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 15 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.942498:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 15 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.942503:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7a00, rc 0) 00000100:00100000:3.0:1789762778.942531:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254868096:12345-0@lo:101: Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762778.942536:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789762778.942539:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254868096:0@lo:101: 00010000:00010000:2.0:1789762778.942552:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762778.942558:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762778.942588:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254868224:0@lo:501: 00000100:00100000:2.0:1789762778.942607:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762778.942621:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca240 going to sleep for 11 seconds 00000100:00100000:0.0:1789762778.942636:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868224 00000100:00100000:0.0:1789762778.942641:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868224 00000100:00100000:0.0:1789762778.942664:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789762778.942670:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254868224:12345-0@lo:501: 00000100:00100000:0.0:1789762778.942734:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254868224:12345-0@lo:501: Request processed in 63us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.942737:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254868224:0@lo:501: 00000100:00100000:2.0:1789762778.942791:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254868352:0@lo:503: 00000100:00100000:0.0:1789762778.942792:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789762778.942842:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.942864:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868352 00000100:00100000:2.0:1789762778.942868:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762778.942869:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868352 00000100:00100000:3.0:1789762778.942901:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762778.942906:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254868352:12345-0@lo:503: 00000100:00100000:3.0:1789762778.942969:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254868352:12345-0@lo:503: Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762778.942981:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789762778.942984:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254868352:0@lo:503: 00000100:00100000:2.0:1789762778.943157:0:7949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7949:1876702254868480:0@lo:502: 00000100:00100000:2.0:1789762778.943185:0:7949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762778.943199:0:7949:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feacab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789762778.943215:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868480 00000100:00100000:0.0:1789762778.943221:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868480 00000100:00100000:0.0:1789762778.943255:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789762778.943263:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:7949:x1876702254868480:12345-0@lo:502: 00000100:00100000:0.0:1789762778.943332:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:7949:x1876702254868480:12345-0@lo:502: Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762778.943337:0:7949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7949:1876702254868480:0@lo:502: 00000100:00100000:0.0:1789762778.943340:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000020:01000000:2.0:1789762778.943366:0:7949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789762778.943371:0:7949:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789762778.943378:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762778.943380:0:7949:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789762778.943385:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789762778.943388:0:7949:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.136@tcp to nid 0x20000c0a8cb88 (192.168.203.136@tcp) 00000020:01000000:2.0:1789762778.943407:0:7949:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789762778.943409:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789762778.943427:0:7949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b33fed20000) 00000020:00000080:2.0:1789762778.943443:0:7949:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789762778.943450:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789762778.943560:0:7949:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789762778.943565:0:7949:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789762778.943574:0:7949:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5915dfb1c1b59049 00010000:00080000:2.0:1789762778.943599:0:7949:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b33fecdd000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:2.0:1789762778.943927:0:7949:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789762778.946442:0:7949:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789762778.946452:0:7949:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789762778.946615:0:7949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789762778.946777:0:7949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789762778.946893:0:7949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789762778.946962:0:7949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789762778.947163:0:7950:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789762778.947168:0:7950:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789762778.947601:0:7949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789762778.947608:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789762778.947630:0:7949:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789762778.947642:0:7949:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5915dfb1c1b59050 00000100:00080000:3.0:1789762778.947648:0:7949:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789762778.947652:0:7949:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b33fecdd000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1789762778.947671:0:7949:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b33e0dcc000 x1876702254868608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789762778.947689:0:7949:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789762778.947714:0:3416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1876702254868608:0@lo:8: 00000020:01000000:3.0:1789762778.947748:0:7949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762778.947776:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762778.947777:0:7949:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789762778.947781:0:7949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789762778.947784:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762778.947786:0:7949:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789762778.947790:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789762778.947792:0:7949:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789762778.947818:0:3416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.947829:0:7949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7949:1876702254868864:0@lo:502: 00000100:00100000:3.0:1789762778.947876:0:7949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762778.947890:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868608 00000100:00100000:0.0:1789762778.947895:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868608 00000100:00100000:3.0:1789762778.947907:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868864 00000100:00100000:3.0:1789762778.947912:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868864 00000100:00100000:0.0:1789762778.947924:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789762778.947931:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3416:x1876702254868608:12345-0@lo:8: 00010000:00080000:0.0:1789762778.947949:0:6909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 81 last 0 00000100:00100000:3.0:1789762778.947954:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789762778.947964:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:7949:x1876702254868864:12345-0@lo:502: 00000020:00000080:0.0:1789762778.947974:0:6909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5915dfb1c1b59057 00002000:00100000:0.0:1789762778.948006:0:6909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b33fe87f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1789762778.948011:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254868736:0@lo:400: 00002000:00080000:0.0:1789762778.948012:0:6909:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789762778.948018:0:6909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789762778.948052:0:6909:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789762778.948053:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:7949:x1876702254868864:12345-0@lo:502: Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.948057:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.948074:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789762778.948108:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254868992:0@lo:400: 00000100:00100000:3.0:1789762778.948113:0:7949:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789762778.948133:0:7949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7949:1876702254868864:0@lo:502: 00000100:00100000:1.0:1789762778.948151:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789762778.948161:0:7949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762778.948166:0:7949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762778.948167:0:7949:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789762778.948171:0:7949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1789762778.948198:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868736 00000100:00100000:1.0:1789762778.948203:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868736 00000020:01000000:3.0:1789762778.948230:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:1.0:1789762778.948247:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254868992 00000100:00100000:1.0:1789762778.948253:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254868992 10000000:01000000:3.0:1789762778.948256:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789762778.948264:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.948272:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762778.948280:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789762778.948282:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b33d8ce99b8 from 1 10000000:01000000:3.0:1789762778.948284:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:1.0:1789762778.948300:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789762778.948303:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762778.948311:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254868736:12345-0@lo:400: 00010000:00010000:3.0:1789762778.948312:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.948323:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762778.948337:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254869120:0@lo:101: 00000100:00100000:1.0:1789762778.948364:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254868736:12345-0@lo:400: Request processed in 55us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.948374:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:0.0:1789762778.948383:0:6909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1789762778.948383:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762778.948400:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789762778.948412:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254868992:12345-0@lo:400: 00000100:00080000:0.0:1789762778.948413:0:6909:0:(import.c:65:import_set_state_nolock()) ffff9b33fe87f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789762778.948418:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.948464:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254868992:12345-0@lo:400: Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.948471:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789762778.948481:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3416:x1876702254868608:12345-0@lo:8: Request processed in 548us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762778.948488:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789762778.948502:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789762778.948544:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b340041ad80 x1876702254868992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762778.948554:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254869120 00000100:00100000:1.0:1789762778.948554:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254868992:0@lo:400: 00000100:00100000:0.0:1789762778.948564:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254869120 00010000:00080000:1.0:1789762778.948587:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3400418000 x1876702254868736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789762794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762778.948596:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254868736:0@lo:400: 00000100:00100000:0.0:1789762778.948600:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789762778.948610:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254869120:12345-0@lo:101: 00010000:00010000:0.0:1789762778.948616:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762778.948626:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b5905e expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.948642:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.948649:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.948655:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef600, rc 0) 00000100:00100000:0.0:1789762778.948692:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254869120:12345-0@lo:101: Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762778.948697:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789762778.948709:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254869120:0@lo:101: 00010000:00010000:3.0:1789762778.948724:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762778.948731:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789762778.948745:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33e0dcc000 x1876702254868608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789762788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762778.948780:0:3416:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789762778.948786:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254869248:0@lo:501: 00000100:00080000:0.0:1789762778.948788:0:3416:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789762778.948805:0:3416:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789762778.948810:0:3416:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789762778.948813:0:3416:0:(import.c:65:import_set_state_nolock()) ffff9b33fecdd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789762778.948828:0:3416:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789762778.948834:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762778.948836:0:3416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1876702254868608:0@lo:8: 00000100:00100000:3.0:1789762778.948876:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789762778.948889:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254869248 00000100:00100000:0.0:1789762778.948894:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254869248 00000004:00080000:3.0:1789762778.948898:0:7950:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789762778.948938:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789762778.948948:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254869248:12345-0@lo:501: 00000100:00100000:0.0:1789762778.949009:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254869248:12345-0@lo:501: Request processed in 63us (175us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789762778.949015:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:3.0:1789762778.949048:0:7950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 81386295569ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789762778.949056:0:7950:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789762778.949057:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254869248:0@lo:501: 10000000:01000000:0.0:1789762778.949090:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789762778.949095:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762778.949101:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762778.950022:0:7951:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789762778.950037:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254869376:0@lo:13: 00000100:00100000:0.0:1789762778.950041:0:7951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254869504:0@lo:7: 00000100:00100000:3.0:1789762778.950080:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762778.950085:0:7951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762778.950109:0:7951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c30ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.950114:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254869376 00000100:00100000:1.0:1789762778.950120:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254869376 00000100:00080000:0.0:1789762778.950147:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762778.950182:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789762778.950192:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254869376:12345-0@lo:13: 00000100:00100000:1.0:1789762778.950207:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254869504 00002000:00000024:3.0:1789762778.950210:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789762778.950212:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254869504 00000100:00100000:1.0:1789762778.950246:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789762778.950259:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3420:x1876702254869376:12345-0@lo:13: Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.950263:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7951:x1876702254869504:12345-0@lo:7: 00000100:00100000:3.0:1789762778.950269:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789762778.950304:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33f453df80 x1876702254869376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762778.950321:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254869376:0@lo:13: 00000004:00080000:0.0:1789762778.950673:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789762778.954025:0:6912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789762778.954029:0:6912:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789762778.954071:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7951:x1876702254869504:12345-0@lo:7: Request processed in 3813us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.954078:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789762778.954101:0:7951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33f453f100 x1876702254869504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789762794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762778.954111:0:7951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254869504:0@lo:7: 00000004:00080000:0.0:1789762778.954118:0:7951:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789762778.954133:0:7951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254869632:0@lo:5: 00000100:00100000:0.0:1789762778.954155:0:7951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762778.954176:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254869632 00000100:00100000:0.0:1789762778.954185:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254869632 00000100:00100000:0.0:1789762778.954228:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789762778.954239:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7951:x1876702254869632:12345-0@lo:5: 00002000:00080000:0.0:1789762778.954257:0:6911:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789762778.954259:0:6911:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789762778.954455:0:7951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c30ae3c0 going to sleep for 11 seconds 00000001:00080000:2.0:1789762778.955961:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789762778.955972:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789762778.956301:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7951:x1876702254869632:12345-0@lo:5: Request processed in 2065us (2143us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789762778.956317:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789762778.956334:0:7951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33f453f100 x1876702254869632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762778.956345:0:7951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789762778.956350:0:7951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254869632:0@lo:5: 00000004:00080000:1.0:1789762778.956362:0:7951:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789762778.956388:0:7951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254869760:0@lo:700: 00000100:00100000:1.0:1789762778.956411:0:7951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762778.956436:0:7951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaf1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762778.956452:0:6918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254869760 00000100:00100000:3.0:1789762778.956457:0:6918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254869760 00000100:00100000:3.0:1789762778.956493:0:6918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789762778.956501:0:6918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7951:x1876702254869760:12345-0@lo:700: 00000100:00100000:1.0:1789762778.956503:0:6919:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:1.0:1789762778.956510:0:6919:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:3.0:1789762778.956530:0:6918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6918:1876702254869888:0@lo:700: 00000100:00100000:3.0:1789762778.956563:0:6918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.956584:0:6918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789762778.956591:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254869888 00000100:00100000:1.0:1789762778.956595:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254869888 00000100:00100000:1.0:1789762778.956622:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789762778.956629:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6918:x1876702254869888:12345-0@lo:700: 40000000:02000000:1.0:1789762778.958319:0:5931:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789762778.960953:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6918:x1876702254869888:12345-0@lo:700: Request processed in 4326us (4389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762778.960961:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789762778.960980:0:6918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33e0dcdf80 x1876702254869888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789762794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762778.960990:0:6918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6918:1876702254869888:0@lo:700: 40000000:02000000:3.0:1789762778.960999:0:6918:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1789762778.967257:0:6918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7951:x1876702254869760:12345-0@lo:700: Request processed in 10755us (10842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762778.967265:0:6918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789762778.967273:0:7951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3400418000 x1876702254869760/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789762794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762778.967293:0:7951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254869760:0@lo:700: 00000004:02000040:1.0:1789762778.968769:0:7951:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789762778.971007:0:7951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254870016:0@lo:5: 00000100:00100000:1.0:1789762778.971041:0:7951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762778.971073:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870016 00000100:00100000:3.0:1789762778.971080:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870016 00000100:00100000:1.0:1789762778.971081:0:7951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaf1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789762778.971119:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789762778.971124:0:6909:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789762778.971130:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7951:x1876702254870016:12345-0@lo:5: 00000100:00100000:1.0:1789762778.971132:0:6909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1789762778.974226:0:6912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789762778.974238:0:6912:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789762778.975440:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7951:x1876702254870016:12345-0@lo:5: Request processed in 4312us (4397us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789762778.975448:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789762778.975472:0:7951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3400418000 x1876702254870016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762778.975486:0:7951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7951:1876702254870016:0@lo:5: 00000004:00080000:0.0:1789762778.975498:0:7951:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789762779.002864:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789762779.081794:0:7981:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789762779.081808:0:7981:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789762779.081810:0:7981:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789762779.081927:0:7981:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b33fecdc800 00000020:01000004:2.0:1789762779.081939:0:7981:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789762779.081949:0:7981:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789762779.081960:0:7981:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b33fed23370) 00000020:00000080:2.0:1789762779.081973:0:7981:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789762779.094942:0:7981:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789762779.094988:0:7981:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789762779.103193:0:7981:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789762779.103394:0:7981:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789762779.103402:0:7981:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789762779.103410:0:7981:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5915dfb1c1b59073 00000020:01000004:3.0:1789762779.103422:0:7981:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789762779.103440:0:7981:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789762779.103443:0:7981:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789762779.103448:0:7981:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789762779.103476:0:7981:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789762779.103480:0:7981:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789762779.111743:0:7981:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789762779.111783:0:7981:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.136@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789762779.111787:0:7981:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789762779.111788:0:7981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789762779.111790:0:7981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762779.111791:0:7981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789762779.111792:0:7981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762779.111793:0:7981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762779.111795:0:7981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789762779.111809:0:7981:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789762779.111810:0:7981:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789762779.111811:0:7981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762779.111812:0:7981:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789762779.111815:0:7981:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789762779.111816:0:7981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789762779.111817:0:7981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789762779.111818:0:7981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762779.111819:0:7981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789762779.111819:0:7981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762779.111820:0:7981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762779.111821:0:7981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789762779.111821:0:7981:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789762779.111822:0:7981:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789762779.111823:0:7981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762779.111824:0:7981:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789762779.111845:0:7981:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789762779.111859:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254870144:0@lo:253: 00000100:00100000:3.0:1789762779.111912:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762779.111949:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870144 00000100:00100000:3.0:1789762779.111952:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3e580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.111957:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870144 00000100:00100000:0.0:1789762779.112000:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762779.112009:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:7981:x1876702254870144:12345-0@lo:253: 20000000:01000000:0.0:1789762779.112042:0:5919:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789762779.112046:0:5919:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789762779.112049:0:5919:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789762779.112052:0:5919:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789762779.112186:0:5919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789762779.112269:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789762779.112280:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789762779.112291:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789762779.112295:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789762779.112303:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789762779.112312:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789762779.112374:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789762779.112387:0:5919:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:0.0:1789762779.112389:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1789762779.112405:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789762779.112412:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789762779.112433:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789762779.112437:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1789762779.112445:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789762779.112449:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789762779.112456:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789762779.112465:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789762779.112841:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789762779.112852:0:5919:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:0.0:1789762779.112854:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1789762779.112862:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789762779.112866:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789762779.112873:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789762779.112876:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1789762779.112884:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789762779.112887:0:5919:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789762779.112894:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789762779.112903:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789762779.112911:0:5919:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789762779.112913:0:5919:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789762779.112915:0:5919:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789762779.112941:0:5919:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789762779.112943:0:5919:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789762779.113125:0:7987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789762779.113231:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789762779.113259:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789762779.113269:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789762779.113276:0:5919:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789762779.113277:0:5919:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789762779.113496:0:7988:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789762779.113515:0:7988:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789762779.113521:0:7988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789762779.113581:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789762779.113604:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789762779.113614:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789762779.113620:0:5919:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789762779.113621:0:5919:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789762779.113841:0:7989:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789762779.113858:0:7989:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789762779.113870:0:7989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789762779.113935:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789762779.113949:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789762779.113957:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789762779.113962:0:5919:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789762779.113964:0:5919:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789762779.114107:0:7990:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789762779.114120:0:7990:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789762779.114137:0:7990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789762779.114187:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789762779.114208:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789762779.114224:0:5919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1789762779.114237:0:5919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789762779.114260:0:5919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114271:0:5919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 16 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114277:0:5919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 16 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114281:0:5919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114286:0:5919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 16 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114296:0:5919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114301:0:5919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114320:0:5919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114329:0:5919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 16 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.114337:0:5919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870272:0@lo:104: 00000100:00100000:3.0:1789762779.114360:0:5919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762779.114387:0:5919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 16 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114394:0:5919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 16 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114400:0:5908:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789762779.114401:0:5919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870400:0@lo:104: 00000100:00100000:0.0:1789762779.114418:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870272 00000100:00100000:0.0:1789762779.114422:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870272 00000100:00100000:3.0:1789762779.114426:0:5919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762779.114447:0:5919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114452:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870400 00000100:00100000:0.0:1789762779.114456:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870400 00010000:00010000:3.0:1789762779.114456:0:5919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 16 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.114466:0:5919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870528:0@lo:104: 00000100:00100000:0.0:1789762779.114473:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789762779.114482:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5919:x1876702254870272:12345-0@lo:104: 00010000:00010000:0.0:1789762779.114492:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.114498:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789762779.114503:0:5919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762779.114515:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5919:x1876702254870400:12345-0@lo:104: 00000100:00100000:1.0:1789762779.114525:0:6925:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:2.0:1789762779.114526:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.114530:0:5919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 16 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.114539:0:6925:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1789762779.114550:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789762779.114551:0:5919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 16 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114561:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5919:x1876702254870272:12345-0@lo:104: Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762779.114566:0:5919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870656:0@lo:104: 00010000:00010000:1.0:1789762779.114570:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789762779.114571:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789762779.114580:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.114589:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6400 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:2.0:1789762779.114590:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1789762779.114593:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.114600:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5919:x1876702254870400:12345-0@lo:104: Request processed in 88us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762779.114607:0:5919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762779.114614:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870528 00010000:00010000:1.0:1789762779.114615:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.114618:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789762779.114619:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870528 10000000:00010000:1.0:1789762779.114628:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762779.114633:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762779.114635:0:5919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 16 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114642:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870656 00010000:00010000:3.0:1789762779.114646:0:5919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 16 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114647:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870656 00000100:00100000:2.0:1789762779.114648:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762779.114663:0:5919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870784:0@lo:104: 00000100:00100000:2.0:1789762779.114664:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5919:x1876702254870528:12345-0@lo:104: 00010000:00010000:1.0:1789762779.114667:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114671:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789762779.114680:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762779.114680:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114685:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5919:x1876702254870656:12345-0@lo:104: 00010000:00010000:1.0:1789762779.114696:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.114697:0:5919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789762779.114698:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.114713:0:5919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3e58d80 going to sleep for 11 seconds 00010000:00010000:1.0:1789762779.114714:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b34021f6400/0x5915dfb1c1b5905e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59065 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.114727:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789762779.114730:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789762779.114735:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5919:x1876702254870528:12345-0@lo:104: Request processed in 76us (236us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762779.114736:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.114741:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789762779.114742:0:5919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870272:0@lo:104: 00000100:00100000:0.0:1789762779.114778:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:5919:x1876702254870656:12345-0@lo:104: Request processed in 71us (150us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762779.114783:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c0030000 already unused, calling callback (ffffffffc1490c20) 00000100:00100000:2.0:1789762779.114784:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 10000000:00010000:1.0:1789762779.114790:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.114807:0:5919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870400:0@lo:104: 00000100:00100000:0.0:1789762779.114812:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789762779.114819:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.114823:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870784 00000100:00100000:2.0:1789762779.114830:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870784 10000000:00010000:1.0:1789762779.114831:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.114832:0:5919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870528:0@lo:104: 10000000:01000000:1.0:1789762779.114843:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789762779.114853:0:5919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870656:0@lo:104: 00000100:00100000:0.0:1789762779.114855:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254870912:0@lo:103: 00010000:00010000:1.0:1789762779.114865:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.114868:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789762779.114875:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789762779.114880:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5919:x1876702254870784:12345-0@lo:104: 00010000:00010000:1.0:1789762779.114882:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.114889:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.114890:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5903b expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114894:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762779.114917:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789762779.114926:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.114928:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254870912 00000100:00100000:3.0:1789762779.114934:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254870912 00010000:00010000:1.0:1789762779.114935:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:1.0:1789762779.114939:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114940:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789762779.114949:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789762779.114950:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.114952:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254871040:0@lo:103: 00010000:00010000:3.0:1789762779.114957:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 17 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.114961:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5919:x1876702254870784:12345-0@lo:104: Request processed in 81us (261us total) trans 0 rc 0/0 10000000:00010000:1.0:1789762779.114973:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.114979:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789762779.114984:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789762779.114990:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789762779.114998:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871040 00000100:00100000:3.0:1789762779.115001:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871040 00010000:00010000:2.0:1789762779.115006:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789762779.115009:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.115014:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.115016:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762779.115024:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 18 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.115025:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:2.0:1789762779.115030:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.115038:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.115040:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762779.115046:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.115050:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b34021f7400/0x5915dfb1c1b59018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5901f expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.115052:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789762779.115053:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 10000000:01000000:2.0:1789762779.115055:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789762779.115067:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254871168:0@lo:103: 00000100:00100000:3.0:1789762779.115068:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:3417:x1876702254870912:12345-0@lo:103: 00010000:00010000:1.0:1789762779.115069:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762779.115077:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115084:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762779.115085:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:2.0:1789762779.115086:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115091:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 18 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789762779.115092:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.115096:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789762779.115101:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762779.115113:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115118:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 18 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.115121:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254871296:0@lo:103: 00010000:00010000:2.0:1789762779.115131:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceec00/0x5915dfb1c1b58fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58ff5 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.115141:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762779.115147:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762779.115150:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cef600/0x5915dfb1c1b59065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b5905e expref: 18 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.115159:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789762779.115164:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.115164:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762779.115169:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762779.115172:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1789762779.115173:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762779.115182:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762779.115195:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.115198:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871168 00010000:00010000:1.0:1789762779.115203:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789762779.115204:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871168 00000100:00100000:0.0:1789762779.115205:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871296 00000100:00100000:0.0:1789762779.115211:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871296 00010000:00010000:1.0:1789762779.115217:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.115224:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254870912:12345-0@lo:103: Request processed in 156us (329us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762779.115225:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 19 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.115232:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 19 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.115232:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee000/0x5915dfb1c1b58fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58fcb expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.115248:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789762779.115272:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762779.115275:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789762779.115276:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762779.115280:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762779.115286:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:3417:x1876702254871040:12345-0@lo:103: 00000100:00100000:1.0:1789762779.115287:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789762779.115288:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762779.115299:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789762779.115301:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762779.115302:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254871424:0@lo:103: 00000100:00100000:0.0:1789762779.115304:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:3420:x1876702254871168:12345-0@lo:103: 00010000:00010000:2.0:1789762779.115310:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 18 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.115315:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:3420:x1876702254871296:12345-0@lo:103: 00010000:00010000:0.0:1789762779.115319:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762779.115326:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 18 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.115328:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 18 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115330:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762779.115340:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 18 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.115346:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762779.115349:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b34021f7a00/0x5915dfb1c1b5903b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59034 expref: 18 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.115358:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 18 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115375:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 17 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.115383:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762779.115390:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b34021f6000/0x5915dfb1c1b58ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58fee expref: 17 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.115398:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c1663400/0x5915dfb1c1b5901f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59018 expref: 17 pid: 5917 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.115415:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:3417:x1876702254871040:12345-0@lo:103: Request processed in 129us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762779.115425:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789762779.115427:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762779.115428:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762779.115452:0:5911:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789762779.115458:0:5911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1789762779.115478:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:3420:x1876702254871296:12345-0@lo:103: Request processed in 167us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.115479:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:3420:x1876702254871168:12345-0@lo:103: Request processed in 181us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762779.115491:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789762779.115500:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762779.115511:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871424 00000100:00100000:3.0:1789762779.115515:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871424 00010000:00010000:3.0:1789762779.115530:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 13 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.115553:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254871040:0@lo:103: 00000100:00100000:3.0:1789762779.115559:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789762779.115563:0:5919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5919:1876702254870784:0@lo:104: 00000100:00100000:1.0:1789762779.115574:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254870912:0@lo:103: 00000100:00100000:3.0:1789762779.115575:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3418:x1876702254871424:12345-0@lo:103: 00010000:00010000:3.0:1789762779.115589:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762779.115593:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 13 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115602:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 13 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.115611:0:5919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115615:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c0031800/0x5915dfb1c1b58fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58fc4 expref: 13 pid: 5920 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115632:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.115639:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254871296:0@lo:103: 00010000:00010000:3.0:1789762779.115640:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.115654:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254871168:0@lo:103: 00010000:00010000:3.0:1789762779.115656:0:5910:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115674:0:5910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115679:0:5910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115684:0:5910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115687:0:5910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762779.115690:0:5910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115695:0:5910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115706:0:5910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.115715:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762779.115719:0:5919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.115726:0:5919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.115731:0:5919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33fec90000/0x5915dfb1c1b5907a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789762779.115742:0:5919:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789762779.115747:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3418:x1876702254871424:12345-0@lo:103: Request processed in 178us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762779.115788:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789762779.115804:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254871424:0@lo:103: 00000100:00100000:0.0:1789762779.116727:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:7981:x1876702254870144:12345-0@lo:253: Request processed in 4718us (4813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.116734:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789762779.116770:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254870144:0@lo:253: 10000000:01000000:3.0:1789762779.116781:0:7981:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789762779.116783:0:7981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789762779.116784:0:7981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789762779.116786:0:7981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789762779.116787:0:7981:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789762779.116788:0:7981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789762779.116794:0:7981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789762779.116806:0:7981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789762779.116808:0:7981:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789762779.116810:0:7981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789762779.116811:0:7981:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789762779.116829:0:7981:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b33fecdc800 from lustre-OST0001 10000000:01000000:3.0:1789762779.116843:0:7981:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789762779.116845:0:7981:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789762779.116849:0:7981:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b33d8ce99b8 local copy 10000000:01000000:3.0:1789762779.116852:0:7981:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789762779.116864:0:7981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.116870:0:7981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.116875:0:7981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.116883:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254871552:0@lo:101: 00000100:00100000:3.0:1789762779.116904:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.116924:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3e58c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.116935:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871552 00000100:00100000:0.0:1789762779.116940:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871552 00000100:00100000:0.0:1789762779.116964:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789762779.116970:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+11:7981:x1876702254871552:12345-0@lo:101: 00010000:00010000:0.0:1789762779.116978:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762779.116986:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b59088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59081 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.117000:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b59088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59081 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.117016:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b59088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59081 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.117021:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cefc00, rc 0) 00000100:00100000:0.0:1789762779.117048:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254871552:12345-0@lo:101: Request processed in 78us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.117053:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789762779.117073:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254871552:0@lo:101: 00010000:00010000:3.0:1789762779.117084:0:7981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117090:0:7981:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.117131:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254871680:0@lo:501: 00000100:00100000:3.0:1789762779.117149:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.117169:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3e58c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.117170:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871680 00000100:00100000:0.0:1789762779.117175:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871680 00000100:00100000:0.0:1789762779.117194:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789762779.117199:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254871680:12345-0@lo:501: 00000100:00100000:0.0:1789762779.117239:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254871680:12345-0@lo:501: Request processed in 40us (88us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789762779.117244:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789762779.117263:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254871680:0@lo:501: 10000000:01000000:3.0:1789762779.117274:0:7981:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789762779.117287:0:7981:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789762779.117290:0:7981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117295:0:7981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117299:0:7981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117310:0:7981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762779.117320:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789762779.117324:0:7981:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b33fecdc800 00010000:00010000:2.0:1789762779.117326:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762779.117328:0:7981:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789762779.117336:0:7981:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:2.0:1789762779.117337:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90c00 already unused, calling callback (ffffffffc1490c20) 10000000:01000000:3.0:1789762779.117340:0:7981:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:00010000:2.0:1789762779.117342:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762779.117344:0:7981:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789762779.117349:0:7981:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789762779.117352:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762779.117359:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117361:0:7981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762779.117363:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762779.117372:0:7981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117378:0:7981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.117388:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254871808:0@lo:101: 00010000:00010000:2.0:1789762779.117389:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.117396:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762779.117412:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.117417:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33fec90c00/0x5915dfb1c1b59081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5915dfb1c1b59088 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.117424:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762779.117426:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789762779.117435:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762779.117438:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762779.117439:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254871936:0@lo:103: 00010000:00010000:2.0:1789762779.117442:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762779.117459:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871808 00000100:00100000:3.0:1789762779.117465:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871808 00000100:00100000:0.0:1789762779.117467:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762779.117492:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254871936 00000100:00100000:2.0:1789762779.117496:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254871936 00000100:00100000:3.0:1789762779.117505:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789762779.117516:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254871808:12345-0@lo:101: 00010000:00010000:3.0:1789762779.117524:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762779.117532:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b5908f expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.117533:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762779.117544:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:3417:x1876702254871936:12345-0@lo:103: 00010000:00010000:3.0:1789762779.117550:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.117552:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762779.117561:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.117565:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cefc00/0x5915dfb1c1b59088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5915dfb1c1b59081 expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117569:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90400, rc 0) 00010000:00010000:2.0:1789762779.117576:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762779.117606:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254871808:12345-0@lo:101: Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762779.117613:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789762779.117619:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3417:x1876702254871936:12345-0@lo:103: Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762779.117625:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789762779.117636:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254871936:0@lo:103: 00000100:00100000:3.0:1789762779.117644:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3e58d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762779.117657:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254871808:0@lo:101: 00010000:00010000:3.0:1789762779.117665:0:7981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.117671:0:7981:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.117711:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872064:0@lo:501: 00000100:00100000:3.0:1789762779.117735:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.117771:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3e58d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.117842:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872064 00000100:00100000:0.0:1789762779.117846:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872064 00000100:00100000:0.0:1789762779.117866:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789762779.117871:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872064:12345-0@lo:501: 00000100:00100000:0.0:1789762779.117926:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872064:12345-0@lo:501: Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.117930:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789762779.117937:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872064:0@lo:501: 00000100:00100000:3.0:1789762779.117962:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872192:0@lo:503: 00000100:00100000:3.0:1789762779.118000:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762779.118028:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872192 00000100:00100000:2.0:1789762779.118033:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872192 00000100:00100000:3.0:1789762779.118034:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3e58d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762779.118066:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789762779.118071:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872192:12345-0@lo:503: 00000100:00100000:2.0:1789762779.118135:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872192:12345-0@lo:503: Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762779.118141:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789762779.118145:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872192:0@lo:503: 00000040:00080000:3.0:1789762779.118261:0:7981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789762779.118302:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872320:0@lo:502: 00000100:00100000:3.0:1789762779.118327:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.118341:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.118359:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872320 00000100:00100000:0.0:1789762779.118370:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872320 00000100:00100000:0.0:1789762779.118401:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789762779.118411:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872320:12345-0@lo:502: 00000100:00100000:0.0:1789762779.119067:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872320:12345-0@lo:502: Request processed in 659us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.119072:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789762779.119092:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872320:0@lo:502: 00000040:00080000:3.0:1789762779.119180:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789762779.119200:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789762779.119216:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789762779.119230:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789762779.119246:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789762779.119258:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789762779.119279:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872448:0@lo:502: 00000100:00100000:3.0:1789762779.119302:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.119321:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762779.119365:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872448 00000100:00100000:2.0:1789762779.119370:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872448 00000100:00100000:2.0:1789762779.119397:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789762779.119403:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872448:12345-0@lo:502: 00000100:00100000:2.0:1789762779.119467:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872448:12345-0@lo:502: Request processed in 63us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762779.119472:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789762779.119476:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872448:0@lo:502: 00000040:00080000:3.0:1789762779.119510:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789762779.119515:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789762779.119704:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789762779.119709:0:7993:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789762779.119715:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789762779.119717:0:7993:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789762779.119721:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789762779.119729:0:7993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b33f4634d28) 00000020:00000080:0.0:1789762779.119739:0:7993:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789762779.119743:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789762779.119820:0:7993:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b33fecdc800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789762779.119825:0:7993:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789762779.119829:0:7993:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5915dfb1c1b590a4 00010000:00010000:0.0:1789762779.121700:0:7993:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789762779.121847:0:7993:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789762779.123471:0:7993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789762779.123593:0:7993:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789762779.125647:0:7993:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789762779.125816:0:7993:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789762779.128461:0:7993:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789762779.129641:0:7993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789762779.129646:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789762779.129649:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789762779.129650:0:7993:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789762779.129653:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789762779.129656:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789762779.129657:0:7993:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789762779.129666:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789762779.129668:0:7993:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789762779.129679:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789762779.129682:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789762779.129683:0:7993:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789762779.129686:0:7993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789762779.129740:0:7981:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789762779.129786:0:7981:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789762779.129817:0:7981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.129825:0:7981:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762779.129832:0:7981:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33fecdc800 from 1 10000000:01000000:3.0:1789762779.129834:0:7981:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789762779.129851:0:7981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.129857:0:7981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.129863:0:7981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.129873:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872576:0@lo:101: 00000100:00100000:3.0:1789762779.129902:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762779.129930:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872576 00000100:00100000:3.0:1789762779.129932:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.129936:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872576 00000100:00100000:0.0:1789762779.129966:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789762779.129972:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:7981:x1876702254872576:12345-0@lo:101: 00010000:00010000:0.0:1789762779.129979:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762779.129988:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b590ab expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.130001:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 13 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.130008:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 13 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.130014:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef200, rc 0) 00000100:00100000:0.0:1789762779.130047:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254872576:12345-0@lo:101: Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.130053:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789762779.130069:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872576:0@lo:101: 00010000:00010000:3.0:1789762779.130080:0:7981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.130087:0:7981:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.130142:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872704:0@lo:501: 00000100:00100000:3.0:1789762779.130169:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.130197:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.130205:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872704 00000100:00100000:0.0:1789762779.130209:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872704 00000100:00100000:0.0:1789762779.130232:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789762779.130238:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254872704:12345-0@lo:501: 00000100:00100000:0.0:1789762779.130302:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254872704:12345-0@lo:501: Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.130317:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789762779.130324:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872704:0@lo:501: 00000100:00100000:3.0:1789762779.130349:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872832:0@lo:503: 00000100:00100000:3.0:1789762779.130385:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.130399:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.130411:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872832 00000100:00100000:0.0:1789762779.130415:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872832 00000100:00100000:0.0:1789762779.130440:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789762779.130444:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254872832:12345-0@lo:503: 00000100:00100000:0.0:1789762779.130514:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254872832:12345-0@lo:503: Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.130521:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789762779.130527:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872832:0@lo:503: 00000040:00080000:3.0:1789762779.130645:0:7981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789762779.130687:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872960:0@lo:502: 00000100:00100000:3.0:1789762779.130718:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.130733:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.130747:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254872960 00000100:00100000:0.0:1789762779.130766:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254872960 00000100:00100000:0.0:1789762779.130792:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789762779.130814:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254872960:12345-0@lo:502: 00000100:00100000:0.0:1789762779.130878:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254872960:12345-0@lo:502: Request processed in 81us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.130884:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789762779.130894:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254872960:0@lo:502: 00000040:00080000:3.0:1789762779.131019:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789762779.131042:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789762779.131060:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873088:0@lo:502: 00000100:00100000:3.0:1789762779.131090:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762779.131110:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873088 00000100:00100000:0.0:1789762779.131115:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873088 00000100:00100000:3.0:1789762779.131115:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.131139:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789762779.131145:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254873088:12345-0@lo:502: 00000100:00100000:0.0:1789762779.131203:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254873088:12345-0@lo:502: Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.131208:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789762779.131237:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873088:0@lo:502: 00000040:00080000:3.0:1789762779.131274:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789762779.131280:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789762779.131492:0:7997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789762779.131497:0:7997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789762779.131499:0:7997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789762779.131505:0:7997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b33fecdc800 00000020:00000080:0.0:1789762779.131508:0:7997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789762779.131524:0:7997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789762779.131527:0:7997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789762779.131529:0:7997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789762779.131532:0:7997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789762779.131574:0:7981:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789762779.131596:0:7981:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789762779.131606:0:7981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.131613:0:7981:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762779.131653:0:7981:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789762779.131655:0:7981:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b33fecdc800 10000000:01000000:3.0:1789762779.131657:0:7981:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b33fecdc800 10000000:01000000:3.0:1789762779.131660:0:7981:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789762779.131663:0:7981:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33fecdc800 from 1 10000000:01000000:3.0:1789762779.131664:0:7981:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789762779.131676:0:7981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.131681:0:7981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.131686:0:7981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.131695:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873216:0@lo:101: 00000100:00100000:3.0:1789762779.131721:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762779.131738:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873216 00000100:00100000:3.0:1789762779.131739:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.131744:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873216 00000100:00100000:0.0:1789762779.131790:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789762779.131795:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:7981:x1876702254873216:12345-0@lo:101: 00010000:00010000:0.0:1789762779.131816:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762779.131824:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b590b9 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.131835:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 14 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.131843:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 14 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762779.131848:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cefe00, rc 0) 00000100:00100000:0.0:1789762779.131875:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873216:12345-0@lo:101: Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.131879:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789762779.131898:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873216:0@lo:101: 00010000:00010000:3.0:1789762779.131909:0:7981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762779.131915:0:7981:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762779.131954:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873344:0@lo:501: 00000100:00100000:3.0:1789762779.131976:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.132008:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789762779.132024:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873344 00000100:00100000:1.0:1789762779.132030:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873344 00000100:00100000:1.0:1789762779.132061:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789762779.132070:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873344:12345-0@lo:501: 00000100:00100000:1.0:1789762779.132140:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873344:12345-0@lo:501: Request processed in 72us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762779.132147:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789762779.132153:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873344:0@lo:501: 00000100:00100000:3.0:1789762779.132178:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873472:0@lo:503: 00000100:00100000:3.0:1789762779.132215:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.132235:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.132236:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873472 00000100:00100000:0.0:1789762779.132241:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873472 00000100:00100000:0.0:1789762779.132264:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789762779.132269:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873472:12345-0@lo:503: 00000100:00100000:0.0:1789762779.132332:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873472:12345-0@lo:503: Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.132337:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789762779.132342:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873472:0@lo:503: 00000040:00080000:3.0:1789762779.132460:0:7981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789762779.132491:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873600:0@lo:502: 00000100:00100000:3.0:1789762779.132522:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.132542:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789762779.132599:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873600 00000100:00100000:1.0:1789762779.132604:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873600 00000100:00100000:1.0:1789762779.132639:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789762779.132649:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873600:12345-0@lo:502: 00000100:00100000:1.0:1789762779.132727:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873600:12345-0@lo:502: Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762779.132736:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789762779.132736:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873600:0@lo:502: 00000040:00080000:3.0:1789762779.132901:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789762779.132927:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789762779.132947:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789762779.132967:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789762779.132986:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789762779.133006:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789762779.133022:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789762779.133050:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789762779.133063:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789762779.133073:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789762779.133084:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789762779.133094:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789762779.133105:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789762779.133115:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789762779.133129:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789762779.133141:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789762779.133152:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789762779.133161:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789762779.133178:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789762779.133198:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789762779.133221:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789762779.133241:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789762779.133259:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789762779.133280:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789762779.133289:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789762779.133297:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789762779.133304:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789762779.133312:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789762779.133319:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789762779.133326:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789762779.133334:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789762779.133342:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789762779.133351:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789762779.133366:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789762779.133383:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789762779.133399:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789762779.133414:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789762779.133434:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873728:0@lo:502: 00000100:00100000:3.0:1789762779.133465:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.133484:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2fb8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789762779.133493:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873728 00000100:00100000:0.0:1789762779.133502:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873728 00000100:00100000:0.0:1789762779.133524:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789762779.133529:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873728:12345-0@lo:502: 00000100:00100000:0.0:1789762779.133585:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254873728:12345-0@lo:502: Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762779.133591:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789762779.133594:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254873728:0@lo:502: 00000040:00080000:3.0:1789762779.133630:0:7981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789762779.133635:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789762779.133912:0:7998:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789762779.133925:0:7998:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b33f725b370) 00000020:00000080:3.0:1789762779.133935:0:7998:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789762779.133982:0:7998:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b33fecdc800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789762779.133985:0:7998:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b33fecdc800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789762779.133987:0:7998:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b33fecdc800 3 00010000:00080000:3.0:1789762779.134014:0:7998:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b33f726d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.136@tcp at head 00010000:00010000:3.0:1789762779.135041:0:7998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789762779.135144:0:7998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789762779.135161:0:7998:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789762779.135168:0:7998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5915dfb1c1b590ce 00000100:00080000:3.0:1789762779.135173:0:7998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789762779.135177:0:7998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b33f726d800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1789762779.135197:0:7998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b33e0dcdf80 x1876702254873856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789762779.135220:0:7998:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789762779.135286:0:3416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1876702254873856:0@lo:38: 00000100:00100000:1.0:1789762779.135323:0:3416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762779.135368:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873856 00000100:00100000:3.0:1789762779.135373:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873856 00000040:00080000:2.0:1789762779.135393:0:7998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789762779.135404:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789762779.135409:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1876702254873856:12345-0@lo:38: 00010000:00080000:3.0:1789762779.135425:0:5924:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 81 last 0 00000020:01000000:1.0:1789762779.135450:0:7981:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000020:00000080:3.0:1789762779.135472:0:5924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5915dfb1c1b590d5 10000000:01000000:1.0:1789762779.135474:0:7981:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00000004:00100000:3.0:1789762779.135486:0:5924:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:1.0:1789762779.135487:0:7981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.135498:0:7981:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789762779.135514:0:7999:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9b33f463ed80 x1876702254873984/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789762779.135521:0:5924:0:(import.c:65:import_set_state_nolock()) ffff9b33f726f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762779.135523:0:7999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f8d2fa80 going to sleep for 0 seconds 00000020:01000004:1.0:1789762779.135537:0:7981:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789762779.135541:0:7981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789762779.135547:0:7981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762779.135549:0:7981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762779.135550:0:7981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762779.135552:0:7981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789762779.135554:0:7981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789762779.135555:0:7981:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762779.135557:0:7981:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762779.135558:0:7981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762779.135560:0:7981:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789762779.135562:0:7981:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789762779.135565:0:7981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789762779.135567:0:7981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000100:00100000:3.0:1789762779.135567:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3416:x1876702254873856:12345-0@lo:38: Request processed in 156us (241us total) trans 0 rc 0/0 00000020:01000004:1.0:1789762779.135571:0:7981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789762779.135575:0:7981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789762779.135577:0:7981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789762779.135579:0:7981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:3.0:1789762779.135580:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1789762779.135581:0:7981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00080000:2.0:1789762779.135584:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33e0dcdf80 x1876702254873856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789762789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1789762779.135585:0:7981:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789762779.135588:0:7981:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789762779.135590:0:7981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789762779.135593:0:7981:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1789762779.135597:0:3416:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789762779.135603:0:3416:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 10000000:01000000:1.0:1789762779.135608:0:7981:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00080000:2.0:1789762779.135609:0:3416:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789762779.135614:0:3416:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789762779.135616:0:3416:0:(import.c:65:import_set_state_nolock()) ffff9b33f726d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789762779.135620:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254874112:0@lo:253: 00000100:00080000:2.0:1789762779.135624:0:3416:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003873541b): req@ffff9b33f463ed80 x1876702254873984/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762779.135641:0:3416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1876702254873856:0@lo:38: 00000100:00100000:1.0:1789762779.135663:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762779.135685:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fc418900 going to sleep for 11 seconds 00000100:00100000:2.0:1789762779.135696:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254874112 00000100:00100000:3.0:1789762779.135700:0:7999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762779.135701:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254874112 00000100:00100000:3.0:1789762779.135720:0:7999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f8d2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762779.135725:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254873984 00000100:00100000:1.0:1789762779.135730:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254873984 00000100:00100000:2.0:1789762779.135742:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789762779.135781:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254874112:12345-0@lo:253: 00000100:00100000:1.0:1789762779.135811:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 20000000:01000000:2.0:1789762779.135811:0:5919:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1789762779.135819:0:5936:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:1.0:1789762779.135824:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7999:x1876702254873984:12345-0@lo:901: 20000000:01000000:2.0:1789762779.135825:0:5919:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789762779.135829:0:5936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00080000:2.0:1789762779.135905:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762779.135908:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7999:x1876702254873984:12345-0@lo:901: Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762779.135916:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789762779.135935:0:7999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b33f463ed80 x1876702254873984/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789762795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762779.135945:0:7999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ed80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7999:1876702254873984:0@lo:901: 20000000:01000000:2.0:1789762779.137477:0:5919:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789762779.137490:0:5919:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789762779.137512:0:5940:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789762779.137517:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789762779.137528:0:5940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.137548:0:5940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.137554:0:5940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.137572:0:5940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.137582:0:5940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.137592:0:5940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b340041b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1876702254874240:0@lo:104: 00000100:00100000:1.0:1789762779.137625:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762779.137641:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:7981:x1876702254874112:12345-0@lo:253: Request processed in 1889us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762779.137649:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789762779.137669:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:7981:1876702254874112:0@lo:253: 00000100:00100000:1.0:1789762779.137669:0:5940:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fc418000 going to sleep for 11 seconds 10000000:01000000:0.0:1789762779.137685:0:7981:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789762779.137687:0:7981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789762779.137688:0:7981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789762779.137689:0:7981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789762779.137691:0:7981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789762779.137692:0:7981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789762779.137694:0:7981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789762779.137696:0:7981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1789762779.137696:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254874240 00000020:01000004:0.0:1789762779.137700:0:7981:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789762779.137702:0:7981:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:2.0:1789762779.137702:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254874240 00000020:01000004:0.0:1789762779.137704:0:7981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789762779.137706:0:7981:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789762779.137717:0:7981:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789762779.137735:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789762779.137743:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5940:x1876702254874240:12345-0@lo:104: 00010000:00010000:2.0:1789762779.137775:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.137833:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789762779.137838:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:5940:x1876702254874240:12345-0@lo:104: Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762779.137845:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789762779.137861:0:5940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b340041b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1876702254874240:0@lo:104: 00010000:00010000:2.0:1789762779.137866:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762779.137872:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762779.137877:0:5940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.137878:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c0031400 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:2.0:1789762779.137884:0:6926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.137892:0:6926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762779.137898:0:6926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762779.137902:0:6926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762779.137922:0:6926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.137926:0:6926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789762779.137941:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.137946:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c0031400/0x5915dfb1c1b59026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5902d expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.137955:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254874368:0@lo:103: 00010000:00010000:2.0:1789762779.137974:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762779.137977:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762779.137979:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762779.137990:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762779.138019:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254874368 00000100:00100000:2.0:1789762779.138024:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254874368 00010000:00010000:2.0:1789762779.138041:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.138064:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789762779.138070:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:3419:x1876702254874368:12345-0@lo:103: 00010000:00010000:2.0:1789762779.138075:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762779.138079:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138087:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138098:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b34021f7000/0x5915dfb1c1b5902d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59026 expref: 14 pid: 5919 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138107:0:5954:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138112:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789762779.138120:0:5954:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000629393s 00010000:00010000:2.0:1789762779.138123:0:5954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138136:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138140:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138145:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138148:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762779.138151:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138156:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138169:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762779.138175:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762779.138197:0:5940:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.138207:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3419:x1876702254874368:12345-0@lo:103: Request processed in 136us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762779.138210:0:5940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762779.138216:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789762779.138226:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b590dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762779.138277:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254874368:0@lo:103: 00080000:10000000:0.0:1789762779.140115:0:7981:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789762779.140226:0:7981:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789762779.140352:0:7981:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789762779.140484:0:7981:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789762779.140623:0:7981:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789762779.140844:0:7981:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789762779.141350:0:7981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789762779.144665:0:7981:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789762779.144669:0:7981:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789762779.144689:0:7981:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789762779.144708:0:7981:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789762779.144720:0:7981:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789762779.144729:0:7981:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789762779.145640:0:7981:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762779.145897:0:7981:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:3.0:1789762779.425996:0:8053:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789762779.426134:0:8053:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789762780.026866:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789762780.863267:0:8342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789762781.051850:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789762781.148118:0:8394:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762781.148277:0:8394:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1789762781.412389:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789762782.075042:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789762782.772343:0:8495:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789762782.772513:0:8495:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1789762783.062276:0:8543:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789762783.062283:0:8543:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789762783.098859:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762783.183584:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.183671:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246469760 00000100:00100000:2.0:1789762783.183688:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246469760 00000100:00100000:2.0:1789762783.183728:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:2.0:1789762783.183736:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1876702246469760:12345-192.168.203.36@tcp:250: 00010000:00080000:2.0:1789762783.183796:0:5920:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a6183be2-02c3-467f-81fa-2ef6138a604e@192.168.203.36@tcp t0 exp 0000000000000000 cur 85 last 0 00000020:00000080:2.0:1789762783.183822:0:5920:0:(genops.c:1385:class_connect()) connect: client a6183be2-02c3-467f-81fa-2ef6138a604e, cookie 0x5915dfb1c1b590e3 00000100:00080000:2.0:1789762783.183922:0:5920:0:(import.c:65:import_set_state_nolock()) ffff9b33ed1bf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762783.183964:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+5:2352:x1876702246469760:12345-192.168.203.36@tcp:250: Request processed in 229us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.183971:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:1.0:1789762783.184622:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.184693:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246469888 00000100:00100000:2.0:1789762783.184699:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246469888 00000100:00100000:2.0:1789762783.184730:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1789762783.184736:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+5:5419:x1876702246469888:12345-192.168.203.36@tcp:101: 00010000:00010000:2.0:1789762783.184744:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762783.184793:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b8789442dd expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.184814:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 6 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.184823:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 6 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.184830:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0030c00, rc 0) 00000100:00100000:2.0:1789762783.184855:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+6:5419:x1876702246469888:12345-192.168.203.36@tcp:101: Request processed in 120us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.184860:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:1.0:1789762783.185560:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.185631:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470016 00000100:00100000:2.0:1789762783.185643:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470016 00000100:00100000:2.0:1789762783.185669:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:2.0:1789762783.185674:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+6:5419:x1876702246470016:12345-192.168.203.36@tcp:501: 00000100:00100000:2.0:1789762783.185744:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+6:5419:x1876702246470016:12345-192.168.203.36@tcp:501: Request processed in 69us (186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789762783.185784:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:0.0:1789762783.186483:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.186557:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470144 00000100:00100000:2.0:1789762783.186562:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470144 00000100:00100000:2.0:1789762783.186588:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:2.0:1789762783.186594:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+6:5419:x1876702246470144:12345-192.168.203.36@tcp:101: 00010000:00010000:2.0:1789762783.186601:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762783.186608:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b8789442e4 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.186622:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 7 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.186628:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 7 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.186633:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0031200, rc 0) 00000100:00100000:2.0:1789762783.186657:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+7:5419:x1876702246470144:12345-192.168.203.36@tcp:101: Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.186662:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:1.0:1789762783.187295:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.187332:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470272 00000100:00100000:2.0:1789762783.187336:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470272 00000100:00100000:2.0:1789762783.187356:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:2.0:1789762783.187361:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+7:5419:x1876702246470272:12345-192.168.203.36@tcp:501: 00000100:00100000:2.0:1789762783.187438:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5419:x1876702246470272:12345-192.168.203.36@tcp:501: Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.187443:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1789762783.188004:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.188039:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470400 00000100:00100000:2.0:1789762783.188043:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470400 00000100:00100000:2.0:1789762783.188063:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:2.0:1789762783.188070:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5419:x1876702246470400:12345-192.168.203.36@tcp:503: 00000100:00100000:2.0:1789762783.188133:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5419:x1876702246470400:12345-192.168.203.36@tcp:503: Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.188138:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:0.0:1789762783.188989:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.189039:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470528 00000100:00100000:2.0:1789762783.189045:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470528 00000100:00100000:2.0:1789762783.189075:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:2.0:1789762783.189084:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5437:x1876702246470528:12345-192.168.203.36@tcp:502: 00000100:00100000:2.0:1789762783.189162:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5437:x1876702246470528:12345-192.168.203.36@tcp:502: Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.189171:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:1.0:1789762783.198584:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.198626:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470656 00000100:00100000:2.0:1789762783.198633:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470656 00000100:00100000:2.0:1789762783.198663:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:2.0:1789762783.198669:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5437:x1876702246470656:12345-192.168.203.36@tcp:502: 00000100:00100000:2.0:1789762783.198791:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5437:x1876702246470656:12345-192.168.203.36@tcp:502: Request processed in 120us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.198798:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:1.0:1789762783.199725:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.199783:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470784 00000100:00100000:2.0:1789762783.199795:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470784 00000100:00100000:2.0:1789762783.199822:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:2.0:1789762783.199830:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5419:x1876702246470784:12345-192.168.203.36@tcp:101: 00010000:00010000:2.0:1789762783.199839:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762783.199850:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c0031600/0x5915dfb1c1b590f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b87894430e expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.199867:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c0031600/0x5915dfb1c1b590f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894430e expref: 9 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.199875:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c0031600/0x5915dfb1c1b590f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894430e expref: 9 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.199881:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0031600, rc 0) 00000100:00100000:2.0:1789762783.199906:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5419:x1876702246470784:12345-192.168.203.36@tcp:101: Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.199911:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:0.0:1789762783.201136:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.201204:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246470912 00000100:00100000:2.0:1789762783.201210:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246470912 00000100:00100000:2.0:1789762783.201236:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:2.0:1789762783.201242:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5419:x1876702246470912:12345-192.168.203.36@tcp:256: 20000000:01000000:2.0:1789762783.201254:0:5919:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789762783.201268:0:5919:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789762783.201272:0:5919:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789762783.201274:0:5919:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789762783.201275:0:5919:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789762783.201864:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5419:x1876702246470912:12345-192.168.203.36@tcp:256: Request processed in 620us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.201871:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:1.0:1789762783.203274:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.203346:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471040 00000100:00100000:2.0:1789762783.203352:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471040 00000100:00100000:2.0:1789762783.203378:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:2.0:1789762783.203384:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5419:x1876702246471040:12345-192.168.203.36@tcp:101: 00010000:00010000:2.0:1789762783.203390:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762783.203398:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b878944315 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.203411:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 10 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.203418:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 10 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762783.203424:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0031a00, rc 0) 00000100:00100000:2.0:1789762783.203447:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5419:x1876702246471040:12345-192.168.203.36@tcp:101: Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.203452:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:0.0:1789762783.204370:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.204443:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471168 00000100:00100000:2.0:1789762783.204448:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471168 00000100:00100000:2.0:1789762783.204474:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:2.0:1789762783.204480:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5419:x1876702246471168:12345-192.168.203.36@tcp:501: 00000100:00100000:2.0:1789762783.204555:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5419:x1876702246471168:12345-192.168.203.36@tcp:501: Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.204561:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:1.0:1789762783.208694:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.208790:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471296 00000100:00100000:2.0:1789762783.208796:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471296 00000100:00100000:2.0:1789762783.208824:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:2.0:1789762783.208838:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5419:x1876702246471296:12345-192.168.203.36@tcp:503: 00000100:00100000:2.0:1789762783.208901:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5419:x1876702246471296:12345-192.168.203.36@tcp:503: Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.208906:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:1.0:1789762783.210370:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.210416:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471424 00000100:00100000:2.0:1789762783.210422:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471424 00000100:00100000:2.0:1789762783.210445:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:2.0:1789762783.210452:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5440:x1876702246471424:12345-192.168.203.36@tcp:502: 00000100:00100000:2.0:1789762783.210513:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5440:x1876702246471424:12345-192.168.203.36@tcp:502: Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.210519:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:0.0:1789762783.211451:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.211522:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471552 00000100:00100000:2.0:1789762783.211527:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471552 00000100:00100000:2.0:1789762783.211554:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:2.0:1789762783.211561:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5440:x1876702246471552:12345-192.168.203.36@tcp:502: 00000100:00100000:2.0:1789762783.211617:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5440:x1876702246471552:12345-192.168.203.36@tcp:502: Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.211622:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:1.0:1789762783.212595:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762783.212647:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471680 00000100:00100000:2.0:1789762783.212652:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471680 00000100:00100000:2.0:1789762783.212677:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1789762783.212681:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1876702246471680:12345-192.168.203.36@tcp:38: 00010000:00080000:2.0:1789762783.212698:0:5926:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 85 last 0 00000020:00000080:2.0:1789762783.212734:0:5926:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b59106 00000004:00100000:2.0:1789762783.212791:0:5926:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789762783.212803:0:5926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789762783.214795:0:5926:0:(import.c:65:import_set_state_nolock()) ffff9b33fed9c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762783.214833:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246471680:12345-192.168.203.36@tcp:38: Request processed in 2150us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762783.214839:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:1.0:1789762784.058952:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254874496:0@lo:13: 00000100:00100000:1.0:1789762784.059016:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762784.059059:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254874496 00000100:00100000:2.0:1789762784.059068:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254874496 00000100:00080000:0.0:1789762784.059130:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762784.059136:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762784.059148:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254874496:12345-0@lo:13: 00002000:00000024:2.0:1789762784.059176:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762784.059220:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254874496:12345-0@lo:13: Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762784.059227:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789762784.059253:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f463df80 x1876702254874496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762784.059261:0:3420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789762784.059292:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254874496:0@lo:13: 00010000:00010000:0.0:1789762784.122859:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762784.216297:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762784.216327:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762784.216366:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471808 00000100:00100000:2.0:1789762784.216377:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471808 00000100:00100000:3.0:1789762784.216411:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246471936 00000100:00100000:3.0:1789762784.216417:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246471936 00000100:00080000:0.0:1789762784.216433:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762784.216443:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:2.0:1789762784.216456:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:0:x1876702246471808:12345-192.168.203.36@tcp:41: 00000100:00100000:3.0:1789762784.216463:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:3.0:1789762784.216475:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:5419:x1876702246471936:12345-192.168.203.36@tcp:41: 00000004:00000024:2.0:1789762784.216490:0:5925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446371328 avail 1300131840 00000004:00000024:3.0:1789762784.216500:0:5924:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789762784.216550:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:0:x1876702246471808:12345-192.168.203.36@tcp:41: Request processed in 99us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762784.216556:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:3.0:1789762784.216562:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:5419:x1876702246471936:12345-192.168.203.36@tcp:41: Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762784.216569:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:0.0:1789762784.217527:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762784.217564:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472064 00000100:00100000:1.0:1789762784.217569:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472064 00000100:00100000:1.0:1789762784.217595:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:1.0:1789762784.217601:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5419:x1876702246472064:12345-192.168.203.36@tcp:40: 00000100:00100000:1.0:1789762784.217638:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5419:x1876702246472064:12345-192.168.203.36@tcp:40: Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762784.217644:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:1.0:1789762784.218441:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762784.218465:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762784.218485:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472192 00000100:00100000:1.0:1789762784.218486:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762784.218492:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472192 00000100:00100000:2.0:1789762784.218518:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472448 00000100:00100000:2.0:1789762784.218521:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472448 00000100:00100000:1.0:1789762784.218545:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:1.0:1789762784.218551:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1876702246472192:12345-192.168.203.36@tcp:8: 00000100:00100000:2.0:1789762784.218556:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:2.0:1789762784.218562:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876702246472448:12345-192.168.203.36@tcp:8: 00010000:00080000:1.0:1789762784.218574:0:7959:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 86 last 0 00000100:00100000:3.0:1789762784.218580:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472320 00010000:00080000:2.0:1789762784.218582:0:6911:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 86 last 0 00000100:00100000:3.0:1789762784.218587:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472320 00000100:00100000:0.0:1789762784.218605:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000020:00000080:1.0:1789762784.218606:0:7959:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b5910d 00000020:00000080:2.0:1789762784.218619:0:6911:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b59114 00002000:00100000:1.0:1789762784.218620:0:7959:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f07ac6c5-9215-4651-bbbc-5b452d5bdd86/ffff9b33fe867800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1789762784.218627:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 98 00002000:00100000:2.0:1789762784.218629:0:6911:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f07ac6c5-9215-4651-bbbc-5b452d5bdd86/ffff9b33fed99800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789762784.218633:0:7959:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789762784.218640:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2353:x1876702246472320:12345-192.168.203.36@tcp:400: 00002000:00100000:2.0:1789762784.218644:0:6911:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789762784.218651:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472576 00000100:00100000:0.0:1789762784.218657:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472576 00000100:00100000:3.0:1789762784.218680:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2353:x1876702246472320:12345-192.168.203.36@tcp:400: Request processed in 45us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762784.218687:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:0.0:1789762784.218693:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1789762784.218703:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5419:x1876702246472576:12345-192.168.203.36@tcp:33: 00002000:00080000:1.0:1789762784.218894:0:7959:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789762784.218925:0:7959:0:(import.c:65:import_set_state_nolock()) ffff9b33fe866800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762784.218966:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246472192:12345-192.168.203.36@tcp:8: Request processed in 414us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762784.218973:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00002000:00080000:2.0:1789762784.219007:0:6911:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789762784.219028:0:6911:0:(import.c:65:import_set_state_nolock()) ffff9b33fed9b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762784.219063:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246472448:12345-192.168.203.36@tcp:8: Request processed in 499us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762784.219070:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000004:00080000:0.0:1789762784.226218:0:5927:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7409us 00000004:00200000:1.0:1789762784.231012:0:5927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789762784.231073:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5419:x1876702246472576:12345-192.168.203.36@tcp:33: Request processed in 12371us (12470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762784.231083:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1789762784.294530:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762784.294622:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472704 00000100:00100000:2.0:1789762784.294632:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472704 00000100:00100000:2.0:1789762784.294682:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1789762784.294691:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5457:x1876702246472704:12345-192.168.203.36@tcp:101: 00010000:00010000:2.0:1789762784.294710:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762784.294730:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031400/0x5915dfb1c1b5911b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894433f expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.294826:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b59122 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.294841:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b59122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.294859:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b59122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762784.294898:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762784.294900:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762784.294913:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b59122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.294946:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031400/0x5915dfb1c1b5911b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894433f expref: 8 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.294961:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b59122 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894433f expref: 7 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762784.294967:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:2.0:1789762784.294970:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762784.294972:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0031800, rc 0) 00000100:00100000:2.0:1789762784.295020:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:5457:x1876702246472704:12345-192.168.203.36@tcp:101: Request processed in 331us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762784.295025:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:1.0:1789762784.571027:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254874752:0@lo:400: 00000100:00100000:0.0:1789762784.571102:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254874624:0@lo:400: 00000100:00100000:1.0:1789762784.571135:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762784.571170:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762784.571200:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254874880:0@lo:400: 00000100:00100000:0.0:1789762784.571267:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254875136:0@lo:400: 00000100:00100000:3.0:1789762784.571282:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254874752 00000100:00100000:2.0:1789762784.571283:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762784.571298:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254874752 00000100:00100000:1.0:1789762784.571334:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254874624 00000100:00100000:1.0:1789762784.571342:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254874624 00000100:00100000:2.0:1789762784.571345:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789762784.571351:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762784.571357:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254875008:0@lo:400: 00000100:00100000:1.0:1789762784.571409:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789762784.571417:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762784.571421:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3417:x1876702254874624:12345-0@lo:400: 00000100:00100000:0.0:1789762784.571437:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254874880 00000100:00100000:0.0:1789762784.571442:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254874880 00000100:00100000:3.0:1789762784.571450:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875136 00000100:00100000:3.0:1789762784.571458:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875136 00000100:00100000:1.0:1789762784.571481:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:3417:x1876702254874624:12345-0@lo:400: Request processed in 64us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762784.571486:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789762784.571495:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789762784.571500:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254874752:12345-0@lo:400: 00000100:00100000:1.0:1789762784.571543:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789762784.571553:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254874752:12345-0@lo:400: Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762784.571555:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254874880:12345-0@lo:400: 00000100:00080000:2.0:1789762784.571563:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762784.571565:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789762784.571580:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875008 00000100:00100000:2.0:1789762784.571585:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875008 00000100:00100000:0.0:1789762784.571594:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789762784.571604:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254874880:12345-0@lo:400: Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762784.571615:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254875136:12345-0@lo:400: 00000100:00100000:2.0:1789762784.571620:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789762784.571630:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254875008:12345-0@lo:400: 00000100:00100000:1.0:1789762784.571655:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789762784.571691:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254875136:12345-0@lo:400: Request processed in 74us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762784.571722:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789762784.571838:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254874752:0@lo:400: 00000100:00100000:2.0:1789762784.571839:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254875008:12345-0@lo:400: Request processed in 124us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762784.571863:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789762784.571899:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254874624:0@lo:400: 00010000:00080000:2.0:1789762784.571934:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f453df80 x1876702254875008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762784.571936:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254875136:0@lo:400: 00000100:00100000:2.0:1789762784.571961:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254875008:0@lo:400: 00000100:00100000:2.0:1789762784.571984:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254874880:0@lo:400: 00010000:00010000:2.0:1789762785.146994:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762785.662439:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762785.662494:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472832 00000100:00100000:2.0:1789762785.662510:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472832 00000100:00100000:2.0:1789762785.662557:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:2.0:1789762785.662565:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:5509:x1876702246472832:12345-192.168.203.36@tcp:41: 00000004:00000024:2.0:1789762785.662598:0:5926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789762785.662653:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:5509:x1876702246472832:12345-192.168.203.36@tcp:41: Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762785.662658:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:0.0:1789762785.663869:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762785.663919:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246472960 00000100:00100000:3.0:1789762785.663925:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246472960 00000100:00080000:2.0:1789762785.663977:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762785.663986:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:3.0:1789762785.663997:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5509:x1876702246472960:12345-192.168.203.36@tcp:13: 00002000:00000024:3.0:1789762785.664019:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762785.664074:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5509:x1876702246472960:12345-192.168.203.36@tcp:13: Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762785.664084:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:0.0:1789762785.664700:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762785.664740:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473088 00000100:00100000:1.0:1789762785.664779:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473088 00000100:00080000:2.0:1789762785.664832:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762785.664833:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:1.0:1789762785.664846:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5509:x1876702246473088:12345-192.168.203.36@tcp:13: 00002000:00000024:1.0:1789762785.664866:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789762785.664907:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5509:x1876702246473088:12345-192.168.203.36@tcp:13: Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762785.664916:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00010000:00010000:2.0:1789762786.171020:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789762786.633972:0:8641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 10000000:01000000:2.0:1789762787.130835:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789762787.130842:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33f46f3000 from 30 10000000:01000000:2.0:1789762787.130849:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789762787.130896:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.130910:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.130923:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.130956:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875264:0@lo:101: 00000100:00100000:2.0:1789762787.131023:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.131074:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875264 00000100:00100000:2.0:1789762787.131074:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.131086:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875264 00000100:00100000:0.0:1789762787.131149:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789762787.131162:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254875264:12345-0@lo:101: 00010000:00010000:0.0:1789762787.131177:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762787.131193:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59129 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.131221:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.131235:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.131246:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0ceec00, rc 0) 00000100:00100000:0.0:1789762787.131301:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254875264:12345-0@lo:101: Request processed in 142us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.131310:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789762787.131329:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875264:0@lo:101: 00010000:00010000:2.0:1789762787.131345:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.131353:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.131399:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875392:0@lo:501: 00000100:00100000:2.0:1789762787.131427:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.131447:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789762787.131468:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875392 00000100:00100000:1.0:1789762787.131474:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875392 00000100:00100000:1.0:1789762787.131502:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789762787.131508:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254875392:12345-0@lo:501: 00000100:00100000:1.0:1789762787.131668:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254875392:12345-0@lo:501: Request processed in 157us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762787.131692:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789762787.131694:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875392:0@lo:501: 00000100:00100000:2.0:1789762787.131725:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875520:0@lo:503: 00000100:00100000:2.0:1789762787.131794:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.131821:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.131835:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875520 00000100:00100000:0.0:1789762787.131848:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875520 00000100:00100000:0.0:1789762787.131891:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789762787.131902:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254875520:12345-0@lo:503: 00000100:00100000:0.0:1789762787.132009:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254875520:12345-0@lo:503: Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.132017:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789762787.132292:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875520:0@lo:503: 00000100:00100000:3.0:1789762787.132505:0:8692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8692:1876702254875648:0@lo:502: 00000100:00100000:3.0:1789762787.132542:0:8692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.132561:0:8692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c5442c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.132580:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875648 00000100:00100000:0.0:1789762787.132588:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875648 00000100:00100000:0.0:1789762787.132626:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789762787.132638:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8692:x1876702254875648:12345-0@lo:502: 00000100:00100000:0.0:1789762787.132781:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8692:x1876702254875648:12345-0@lo:502: Request processed in 118us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.132782:0:8692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8692:1876702254875648:0@lo:502: 00000100:00100000:0.0:1789762787.132798:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789762787.132836:0:8692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8692:1876702254875776:0@lo:502: 00000100:00100000:3.0:1789762787.132873:0:8692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.132901:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875776 00000100:00100000:0.0:1789762787.132907:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875776 00000100:00100000:3.0:1789762787.132909:0:8692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c5442c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.132949:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789762787.132960:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8692:x1876702254875776:12345-0@lo:502: 00000100:00100000:0.0:1789762787.133049:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8692:x1876702254875776:12345-0@lo:502: Request processed in 90us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.133056:0:8692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8692:1876702254875776:0@lo:502: 00000100:00100000:0.0:1789762787.133062:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000040:00080000:3.0:1789762787.133080:0:8692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789762787.133147:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789762787.133185:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789762787.133195:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.133205:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762787.133227:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789762787.133229:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789762787.133232:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789762787.133252:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.133261:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.133270:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.133285:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875904:0@lo:101: 00000100:00100000:0.0:1789762787.133321:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.133347:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254875904 00000100:00100000:0.0:1789762787.133349:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789762787.133351:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254875904 00000100:00100000:3.0:1789762787.133382:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789762787.133389:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254875904:12345-0@lo:101: 00010000:00010000:3.0:1789762787.133396:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762787.133405:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59137 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.133418:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 15 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.133425:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 15 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.133442:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90200, rc 0) 00000100:00100000:3.0:1789762787.133479:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254875904:12345-0@lo:101: Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.133485:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789762787.133501:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254875904:0@lo:101: 00010000:00010000:0.0:1789762787.133519:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.133530:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.133585:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876032:0@lo:501: 00000100:00100000:0.0:1789762787.133619:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.133642:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876032 00000100:00100000:0.0:1789762787.133643:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789762787.133647:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876032 00000100:00100000:3.0:1789762787.133670:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789762787.133676:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254876032:12345-0@lo:501: 00000100:00100000:3.0:1789762787.133746:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254876032:12345-0@lo:501: Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.133778:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789762787.133786:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876032:0@lo:501: 00000100:00100000:0.0:1789762787.133823:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876160:0@lo:503: 00000100:00100000:0.0:1789762787.133870:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.133894:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876160 00000100:00100000:3.0:1789762787.133898:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876160 00000100:00100000:0.0:1789762787.133902:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789762787.133924:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789762787.133929:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254876160:12345-0@lo:503: 00000100:00100000:3.0:1789762787.133989:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254876160:12345-0@lo:503: Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.133994:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789762787.134014:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876160:0@lo:503: 00000100:00100000:3.0:1789762787.134165:0:8693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8693:1876702254876288:0@lo:502: 00000100:00100000:3.0:1789762787.134193:0:8693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.134207:0:8693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c54423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.134219:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876288 00000100:00100000:0.0:1789762787.134225:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876288 00000100:00100000:0.0:1789762787.134256:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789762787.134266:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8693:x1876702254876288:12345-0@lo:502: 00000100:00100000:0.0:1789762787.134352:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8693:x1876702254876288:12345-0@lo:502: Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.134361:0:8693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8693:1876702254876288:0@lo:502: 00000100:00100000:0.0:1789762787.134362:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000020:01000000:3.0:1789762787.134391:0:8693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789762787.134401:0:8693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762787.134404:0:8693:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789762787.134418:0:8693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789762787.134421:0:8693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789762787.134438:0:8693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8693:1876702254876416:0@lo:502: 00000100:00100000:3.0:1789762787.134475:0:8693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.134491:0:8693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c54423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.134502:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876416 00000100:00100000:0.0:1789762787.134508:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876416 00000100:00100000:0.0:1789762787.134542:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789762787.134550:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8693:x1876702254876416:12345-0@lo:502: 00000100:00100000:0.0:1789762787.134622:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8693:x1876702254876416:12345-0@lo:502: Request processed in 72us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.134630:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789762787.134631:0:8693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8693:1876702254876416:0@lo:502: 00000020:01000000:3.0:1789762787.134654:0:8693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762787.134658:0:8693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762787.134659:0:8693:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789762787.134662:0:8693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789762787.134701:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789762787.134730:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789762787.135098:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.135106:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762787.135112:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789762787.135113:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33c8a8a800 from 30 10000000:01000000:0.0:1789762787.135115:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789762787.135135:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.135140:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.135145:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.135154:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876544:0@lo:101: 00000100:00100000:0.0:1789762787.135179:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.135204:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762787.135214:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876544 00000100:00100000:3.0:1789762787.135219:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876544 00000100:00100000:3.0:1789762787.135244:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789762787.135249:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254876544:12345-0@lo:101: 00010000:00010000:3.0:1789762787.135255:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762787.135262:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59145 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.135273:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.135281:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.135286:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec91200, rc 0) 00000100:00100000:3.0:1789762787.135312:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254876544:12345-0@lo:101: Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.135317:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789762787.135339:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876544:0@lo:101: 00010000:00010000:0.0:1789762787.135352:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.135362:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.135403:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876672:0@lo:501: 00000100:00100000:0.0:1789762787.135433:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.135453:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762787.135465:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876672 00000100:00100000:3.0:1789762787.135474:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876672 00000100:00100000:3.0:1789762787.135498:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789762787.135505:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254876672:12345-0@lo:501: 00000100:00100000:3.0:1789762787.135575:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254876672:12345-0@lo:501: Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.135580:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789762787.135609:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876672:0@lo:501: 00000100:00100000:0.0:1789762787.135637:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876800:0@lo:503: 00000100:00100000:0.0:1789762787.135681:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.135701:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876800 00000100:00100000:0.0:1789762787.135703:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762787.135705:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876800 00000100:00100000:3.0:1789762787.135731:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789762787.135989:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254876800:12345-0@lo:503: 00000100:00100000:3.0:1789762787.136053:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254876800:12345-0@lo:503: Request processed in 315us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.136062:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789762787.136073:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254876800:0@lo:503: 00000100:00100000:3.0:1789762787.136247:0:8694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8694:1876702254876928:0@lo:502: 00000100:00100000:3.0:1789762787.136278:0:8694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.136296:0:8694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c5442540 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.136306:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254876928 00000100:00100000:0.0:1789762787.136319:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254876928 00000100:00100000:0.0:1789762787.136359:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789762787.136369:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8694:x1876702254876928:12345-0@lo:502: 00000100:00100000:0.0:1789762787.136453:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8694:x1876702254876928:12345-0@lo:502: Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.136464:0:8694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8694:1876702254876928:0@lo:502: 00000100:00100000:0.0:1789762787.136465:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789762787.136504:0:8694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8694:1876702254877056:0@lo:502: 00000100:00100000:3.0:1789762787.136529:0:8694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.136543:0:8694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c5442540 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.136554:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877056 00000100:00100000:0.0:1789762787.136560:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877056 00000100:00100000:0.0:1789762787.136595:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789762787.136605:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8694:x1876702254877056:12345-0@lo:502: 00000100:00100000:0.0:1789762787.136690:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8694:x1876702254877056:12345-0@lo:502: Request processed in 86us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.136693:0:8694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8694:1876702254877056:0@lo:502: 00000100:00100000:0.0:1789762787.136706:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000040:00080000:3.0:1789762787.136718:0:8694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789762787.136809:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789762787.136828:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789762787.136833:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.136841:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762787.136847:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789762787.136848:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b33c8a8a800 from 5 10000000:01000000:1.0:1789762787.136850:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789762787.136868:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b59153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.136873:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b59153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.136879:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b59153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.136888:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877184:0@lo:101: 00000100:00100000:1.0:1789762787.136912:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.136938:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877184 00000100:00100000:1.0:1789762787.136944:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789762787.136944:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877184 00000100:00100000:2.0:1789762787.136978:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789762787.136986:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254877184:12345-0@lo:101: 00010000:00010000:2.0:1789762787.136992:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762787.136999:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c0031400/0x5915dfb1c1b5915a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59153 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.137011:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c0031400/0x5915dfb1c1b5915a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59153 expref: 17 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.137017:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c0031400/0x5915dfb1c1b5915a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59153 expref: 17 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.137028:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0031400, rc 0) 00000100:00100000:2.0:1789762787.137057:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254877184:12345-0@lo:101: Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762787.137062:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789762787.137088:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877184:0@lo:101: 00010000:00010000:1.0:1789762787.137099:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b59153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5915a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.137105:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b59153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5915a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.137149:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877312:0@lo:256: 00000100:00100000:1.0:1789762787.137180:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.137195:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.137208:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877312 00000100:00100000:0.0:1789762787.137214:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877312 00000100:00100000:0.0:1789762787.137247:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789762787.137256:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254877312:12345-0@lo:256: 20000000:01000000:0.0:1789762787.137269:0:5917:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789762787.137284:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789762787.137287:0:5917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789762787.137397:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254877312:12345-0@lo:256: Request processed in 142us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762787.137405:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877312:0@lo:256: 00000100:00100000:0.0:1789762787.137407:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 10000000:01000000:1.0:1789762787.137459:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789762787.137464:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b59153 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5915a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.137469:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c1663400/0x5915dfb1c1b59153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5915a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762787.137474:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789762787.137475:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789762787.137476:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789762787.137487:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.137492:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.137497:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.137513:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877440:0@lo:101: 00000100:00100000:1.0:1789762787.137538:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.137558:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.137568:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877440 00000100:00100000:0.0:1789762787.137573:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877440 00000100:00100000:0.0:1789762787.137602:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789762787.137613:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254877440:12345-0@lo:101: 00010000:00010000:0.0:1789762787.137620:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762787.137637:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59161 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.137655:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.137665:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.137674:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee200, rc 0) 00000100:00100000:0.0:1789762787.137719:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254877440:12345-0@lo:101: Request processed in 108us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.137727:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789762787.137733:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877440:0@lo:101: 00010000:00010000:3.0:1789762787.138190:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.138209:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.138249:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877568:0@lo:501: 00000100:00100000:3.0:1789762787.138275:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.138305:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c5442540 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.138375:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877568 00000100:00100000:0.0:1789762787.138381:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877568 00000100:00100000:0.0:1789762787.138412:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789762787.138421:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254877568:12345-0@lo:501: 00000100:00100000:0.0:1789762787.138537:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254877568:12345-0@lo:501: Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.138542:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877568:0@lo:501: 00000100:00100000:0.0:1789762787.138554:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789762787.138574:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877696:0@lo:503: 00000100:00100000:3.0:1789762787.138613:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.138635:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c5442540 going to sleep for 11 seconds 00000100:00100000:2.0:1789762787.138671:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877696 00000100:00100000:2.0:1789762787.138677:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877696 00000100:00100000:2.0:1789762787.138714:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789762787.138723:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254877696:12345-0@lo:503: 00000100:00100000:2.0:1789762787.138869:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254877696:12345-0@lo:503: Request processed in 148us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762787.138876:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789762787.138883:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254877696:0@lo:503: 00000100:00100000:3.0:1789762787.139062:0:8696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8696:1876702254877824:0@lo:502: 00000100:00100000:3.0:1789762787.139100:0:8696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.139124:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877824 00000100:00100000:3.0:1789762787.139126:0:8696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c5442e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.139130:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877824 00000100:00100000:0.0:1789762787.139169:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789762787.139178:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8696:x1876702254877824:12345-0@lo:502: 00000100:00100000:0.0:1789762787.139284:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8696:x1876702254877824:12345-0@lo:502: Request processed in 106us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.139293:0:8696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8696:1876702254877824:0@lo:502: 00000100:00100000:0.0:1789762787.139296:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000020:01000000:3.0:1789762787.139336:0:8696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789762787.139342:0:8696:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789762787.139348:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762787.139350:0:8696:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789762787.139356:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789762787.139360:0:8696:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.136@tcp to nid 0x20000c0a8cb88 (192.168.203.136@tcp) 00000020:01000000:3.0:1789762787.139381:0:8696:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789762787.139384:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789762787.139412:0:8696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b33f72599b8) 00000020:00000080:3.0:1789762787.139426:0:8696:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789762787.139435:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789762787.139521:0:8696:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789762787.139525:0:8696:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789762787.139531:0:8696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5915dfb1c1b59176 00010000:00080000:3.0:1789762787.139557:0:8696:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b33fe878000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:3.0:1789762787.140027:0:8696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789762787.140152:0:8696:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789762787.140161:0:8696:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789762787.140288:0:8696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789762787.140417:0:8696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789762787.140555:0:8696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789762787.140643:0:8696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789762787.140869:0:8697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789762787.140873:0:8697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789762787.141209:0:8696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789762787.141217:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789762787.141248:0:8696:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789762787.141262:0:8696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5915dfb1c1b5917d 00000100:00080000:2.0:1789762787.141268:0:8696:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789762787.141272:0:8696:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b33fe878000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:2.0:1789762787.141292:0:8696:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b33f463ca80 x1876702254877952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789762787.141313:0:8696:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789762787.141334:0:3416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1876702254877952:0@lo:8: 00000020:01000000:2.0:1789762787.141362:0:8696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762787.141367:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762787.141369:0:8696:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000100:00100000:3.0:1789762787.141375:0:3416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789762787.141377:0:8696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762787.141381:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762787.141383:0:8696:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789762787.141387:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789762787.141394:0:8696:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789762787.141410:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254877952 00000100:00100000:2.0:1789762787.141416:0:8696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8696:1876702254878592:0@lo:502: 00000100:00100000:1.0:1789762787.141417:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254877952 00000100:00100000:0.0:1789762787.141427:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254878080:0@lo:400: 00000100:00100000:1.0:1789762787.141459:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789762787.141459:0:8696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.141469:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3416:x1876702254877952:12345-0@lo:8: 00000100:00100000:0.0:1789762787.141483:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.141487:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878592 00010000:00080000:1.0:1789762787.141488:0:7959:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 89 last 0 00000100:00100000:2.0:1789762787.141493:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878592 00000100:00100000:3.0:1789762787.141511:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878080 00000020:00000080:1.0:1789762787.141513:0:7959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5915dfb1c1b59184 00000100:00100000:3.0:1789762787.141516:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878080 00000100:00100000:0.0:1789762787.141520:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00100000:1.0:1789762787.141528:0:7959:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b33fc412000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396a ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:0.0:1789762787.141533:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254878464:0@lo:400: 00000100:00100000:2.0:1789762787.141533:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00002000:00080000:1.0:1789762787.141535:0:7959:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789762787.141543:0:7959:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789762787.141552:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8696:x1876702254878592:12345-0@lo:502: 00000100:00100000:3.0:1789762787.141552:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762787.141563:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254878080:12345-0@lo:400: 00000100:00100000:0.0:1789762787.141572:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1789762787.141583:0:7959:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789762787.141613:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254878080:12345-0@lo:400: Request processed in 51us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.141618:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254878080:0@lo:400: 00000100:00100000:3.0:1789762787.141624:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789762787.141640:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8696:x1876702254878592:12345-0@lo:502: Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.141643:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878464 00000100:00100000:3.0:1789762787.141648:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878464 00000100:00100000:2.0:1789762787.141650:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789762787.141666:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254878208:0@lo:400: 00000100:00100000:3.0:1789762787.141685:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789762787.141692:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762787.141697:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254878464:12345-0@lo:400: 00000100:00100000:2.0:1789762787.141707:0:8696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70840 going to sleep for 11 seconds 00000100:00100000:0.0:1789762787.141711:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.141725:0:8696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8696:1876702254878592:0@lo:502: 00000020:01000000:2.0:1789762787.141790:0:8696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1789762787.141794:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254878464:12345-0@lo:400: Request processed in 99us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.141795:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000080:2.0:1789762787.141796:0:8696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762787.141802:0:8696:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00002000:00080000:1.0:1789762787.141803:0:7959:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000040:00080000:2.0:1789762787.141805:0:8696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1789762787.141809:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254878336:0@lo:400: 00000100:00080000:1.0:1789762787.141822:0:7959:0:(import.c:65:import_set_state_nolock()) ffff9b33fc416000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789762787.141823:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789762787.141844:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878208 00000100:00100000:3.0:1789762787.141848:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878208 00000100:00100000:0.0:1789762787.141853:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.141883:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789762787.141888:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3416:x1876702254877952:12345-0@lo:8: Request processed in 416us (513us total) trans 0 rc 0/0 00000100:00080000:2.0:1789762787.141888:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762787.141895:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254878208:12345-0@lo:400: 00000100:00100000:1.0:1789762787.141901:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789762787.141921:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878336 00000100:00100000:1.0:1789762787.141925:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878336 00000100:00100000:3.0:1789762787.141945:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254878208:12345-0@lo:400: Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.141947:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254878464:0@lo:400: 00000100:00100000:3.0:1789762787.141955:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789762787.141960:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254878208:0@lo:400: 00000020:01000000:0.0:1789762787.141971:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:1.0:1789762787.141976:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762787.141988:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254878336:12345-0@lo:400: 00000100:00080000:2.0:1789762787.141989:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1789762787.141992:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789762787.142000:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.142008:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762787.142015:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789762787.142017:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b33d8ce99b8 from 1 10000000:01000000:0.0:1789762787.142019:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789762787.142032:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.142041:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.142042:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254878336:12345-0@lo:400: Request processed in 53us (186us total) trans 0 rc 0/0 00010000:00080000:2.0:1789762787.142044:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f453c380 x1876702254878336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762787.142065:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254878336:0@lo:400: 00000100:00100000:1.0:1789762787.142066:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789762787.142077:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.142089:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254878720:0@lo:101: 00010000:00080000:1.0:1789762787.142115:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f463ca80 x1876702254877952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789762797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762787.142118:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.142130:0:3416:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789762787.142137:0:3416:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:0.0:1789762787.142145:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1d80 going to sleep for 11 seconds 00000100:00080000:1.0:1789762787.142146:0:3416:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:3.0:1789762787.142154:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878720 00000100:00080000:1.0:1789762787.142155:0:3416:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:3.0:1789762787.142160:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878720 00000100:00080000:1.0:1789762787.142161:0:3416:0:(import.c:65:import_set_state_nolock()) ffff9b33fe878000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789762787.142182:0:3416:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789762787.142189:0:3416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1876702254877952:0@lo:8: 00000100:00100000:3.0:1789762787.142192:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789762787.142205:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254878720:12345-0@lo:101: 00010000:00010000:3.0:1789762787.142210:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762787.142218:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b5918b expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.142232:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 19 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.142239:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 19 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.142244:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec91600, rc 0) 00000100:00100000:3.0:1789762787.142275:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254878720:12345-0@lo:101: Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.142281:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789762787.142300:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254878720:0@lo:101: 00000004:00080000:3.0:1789762787.142311:0:8697:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:0.0:1789762787.142316:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.142326:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.142382:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254878848:0@lo:501: 00000100:00100000:0.0:1789762787.142422:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762787.142448:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878848 00000100:00100000:0.0:1789762787.142450:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762787.142458:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878848 00000100:00100000:3.0:1789762787.142485:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789762787.142493:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254878848:12345-0@lo:501: 00000100:00100000:3.0:1789762787.142540:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254878848:12345-0@lo:501: Request processed in 49us (120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789762787.142545:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789762787.142574:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254878848:0@lo:501: 10000000:01000000:0.0:1789762787.142606:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789762787.142612:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.142620:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762787.142934:0:8697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 89580181620ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789762787.142940:0:8697:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:0.0:1789762787.143381:0:5903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000100:00100000:1.0:1789762787.143458:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762787.143468:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254878976:0@lo:13: 00000100:00100000:1.0:1789762787.143506:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.143556:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254878976 00000004:00080000:1.0:1789762787.143559:0:8698:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789762787.143570:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254878976 00000100:00100000:1.0:1789762787.143602:0:8698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879104:0@lo:7: 00000100:00100000:1.0:1789762787.143634:0:8698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.143662:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254879104 00000100:00100000:1.0:1789762787.143665:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254879104 00000100:00100000:0.0:1789762787.143672:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789762787.143685:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3417:x1876702254878976:12345-0@lo:13: 00000100:00100000:1.0:1789762787.143696:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00002000:00000024:0.0:1789762787.143702:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789762787.143707:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8698:x1876702254879104:12345-0@lo:7: 00000100:00100000:0.0:1789762787.143788:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3417:x1876702254878976:12345-0@lo:13: Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.143794:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789762787.143836:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789762787.143868:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3400418a80 x1876702254878976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762787.143890:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254878976:0@lo:13: 00000004:00080000:2.0:1789762787.144005:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789762787.144830:0:8698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46180 going to sleep for 11 seconds 00002000:00080000:1.0:1789762787.147113:0:6911:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789762787.147119:0:6911:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789762787.147161:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8698:x1876702254879104:12345-0@lo:7: Request processed in 3458us (3527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762787.147168:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789762787.147191:0:8698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f47fb800 x1876702254879104/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789762803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762787.147201:0:8698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879104:0@lo:7: 00000004:00080000:0.0:1789762787.147209:0:8698:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789762787.147225:0:8698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879232:0@lo:5: 00000100:00100000:0.0:1789762787.147250:0:8698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.147279:0:8698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762787.147282:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254879232 00000100:00100000:2.0:1789762787.147287:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254879232 00000100:00100000:2.0:1789762787.147317:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789762787.147324:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8698:x1876702254879232:12345-0@lo:5: 00002000:00080000:2.0:1789762787.147340:0:6909:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789762787.147343:0:6909:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1789762787.149174:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789762787.149189:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789762787.149197:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000100:00100000:2.0:1789762787.149288:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8698:x1876702254879232:12345-0@lo:5: Request processed in 1965us (2035us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789762787.149295:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789762787.149324:0:8698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f453d180 x1876702254879232/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762787.149335:0:8698:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789762787.149341:0:8698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879232:0@lo:5: 00000004:00080000:0.0:1789762787.149351:0:8698:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789762787.149381:0:8698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879360:0@lo:700: 00000100:00100000:0.0:1789762787.149429:0:8698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.149470:0:7953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254879360 00000100:00100000:0.0:1789762787.149474:0:8698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762787.149475:0:7953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254879360 00000100:00100000:2.0:1789762787.149510:0:7953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789762787.149518:0:7953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8698:x1876702254879360:12345-0@lo:700: 00000100:00100000:2.0:1789762787.149549:0:7953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:7953:1876702254879488:0@lo:700: 00000100:00100000:2.0:1789762787.149573:0:7953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.149589:0:7953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70840 going to sleep for 11 seconds 00000100:00100000:1.0:1789762787.149604:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254879488 00000100:00100000:1.0:1789762787.149610:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254879488 00000100:00100000:1.0:1789762787.149643:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789762787.149652:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7953:x1876702254879488:12345-0@lo:700: 40000000:02000000:3.0:1789762787.151176:0:5931:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789762787.153878:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7953:x1876702254879488:12345-0@lo:700: Request processed in 4225us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762787.153898:0:7953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:7953:1876702254879488:0@lo:700: 00000100:00100000:3.0:1789762787.153899:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 40000000:02000000:2.0:1789762787.153910:0:7953:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789762787.160367:0:7953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8698:x1876702254879360:12345-0@lo:700: Request processed in 10848us (10937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.160377:0:7953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789762787.160388:0:8698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f453d180 x1876702254879360/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789762803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762787.160399:0:8698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879360:0@lo:700: 00000004:02000040:0.0:1789762787.161911:0:8698:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789762787.163973:0:8698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879616:0@lo:5: 00000100:00100000:0.0:1789762787.164006:0:8698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.164046:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254879616 00000100:00100000:0.0:1789762787.164048:0:8698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fedc1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762787.164056:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254879616 00000100:00100000:1.0:1789762787.164129:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789762787.164138:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8698:x1876702254879616:12345-0@lo:5: 00002000:00080000:1.0:1789762787.168666:0:6912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789762787.168684:0:6912:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789762787.171083:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8698:x1876702254879616:12345-0@lo:5: Request processed in 6944us (7074us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789762787.171092:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789762787.171112:0:8698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f453d180 x1876702254879616/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789762803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762787.171127:0:8698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8698:1876702254879616:0@lo:5: 00000004:00080000:0.0:1789762787.171139:0:8698:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789762787.194847:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789762787.804427:0:8794:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe58f129f0 20000000:00000080:0.0:1789762787.804443:0:8794:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b33f7208000 uarg=0000000000000000 20000000:01000000:0.0:1789762787.804480:0:8794:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789762787.804482:0:8794:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789762787.804485:0:8794:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789762787.804489:0:8794:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789762787.804494:0:8794:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789762787.804544:0:8794:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789762787.804547:0:8794:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789762787.804870:0:8795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789762787.805050:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789762787.805080:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789762787.805094:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789762787.805103:0:8794:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789762787.805105:0:8794:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789762787.805386:0:8796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789762787.805547:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789762787.805576:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789762787.805592:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1789762787.805614:0:8794:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789762787.805617:0:8794:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789762787.805919:0:8797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789762787.806012:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789762787.806031:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789762787.806042:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789762787.806050:0:8794:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789762787.806052:0:8794:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789762787.806242:0:8798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789762787.806362:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789762787.806413:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789762787.806438:0:8794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1789762787.806452:0:8794:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789762787.806470:0:8794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806487:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806494:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 18 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806503:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 9 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806509:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 9 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806514:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806521:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806526:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806532:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806544:0:8794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806551:0:8794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806597:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806610:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.806623:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254879744:0@lo:104: 00000100:00100000:0.0:1789762787.806718:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.806912:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254879744 00000100:00100000:1.0:1789762787.806922:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254879744 00010000:00010000:0.0:1789762787.806967:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.806977:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.806982:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789762787.806997:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254879872:0@lo:104: 00000100:00100000:1.0:1789762787.807004:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:8794:x1876702254879744:12345-0@lo:104: 00010000:00010000:1.0:1789762787.807019:0:7991:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.807030:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.807060:0:5907:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789762787.807066:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.807076:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 18 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.807077:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254879872 00000100:00100000:2.0:1789762787.807085:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254879872 00000100:00100000:0.0:1789762787.807092:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880000:0@lo:104: 00010000:00010000:1.0:1789762787.807112:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762787.807126:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254879744:12345-0@lo:104: Request processed in 126us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762787.807128:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789762787.807137:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.807149:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789762787.807150:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33feded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254879872:12345-0@lo:104: 00010000:00010000:2.0:1789762787.807164:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.807179:0:6925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254880000 00010000:00010000:0.0:1789762787.807184:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.807190:0:6925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254880000 00010000:00010000:0.0:1789762787.807197:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.807208:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880128:0@lo:104: 00010000:00010000:2.0:1789762787.807233:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789762787.807240:0:6925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789762787.807246:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.807252:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33feded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254879872:12345-0@lo:104: Request processed in 104us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.807261:0:6925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254880000:12345-0@lo:104: 00000100:00100000:2.0:1789762787.807272:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789762787.807281:0:6925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.807284:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807291:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254880128 00000100:00100000:1.0:1789762787.807317:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254880128 00010000:00010000:0.0:1789762787.807330:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 18 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807340:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789762787.807347:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880256:0@lo:104: 00010000:00010000:2.0:1789762787.807349:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807361:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:2.0:1789762787.807366:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807376:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789762787.807377:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762787.807389:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807393:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254880128:12345-0@lo:104: 00010000:00010000:3.0:1789762787.807402:0:6925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789762787.807409:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762787.807410:0:7991:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.807439:0:6925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254880000:12345-0@lo:104: Request processed in 180us (302us total) trans 0 rc 0/0 10000000:01000000:2.0:1789762787.807445:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789762787.807464:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 9 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.807465:0:6925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789762787.807490:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 9 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.807498:0:6925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254880256 00010000:00010000:1.0:1789762787.807503:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789762787.807507:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880384:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762787.807508:0:6925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254880256 00010000:00010000:2.0:1789762787.807509:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807525:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254880128:12345-0@lo:104: Request processed in 135us (280us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762787.807528:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789762787.807540:0:6925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789762787.807551:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789762787.807552:0:6925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8794:x1876702254880256:12345-0@lo:104: 00010000:00010000:2.0:1789762787.807562:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.807572:0:6925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807577:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee600/0x5915dfb1c1b5918b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59192 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807599:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789762787.807603:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789762787.807609:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807616:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663800 already unused, calling callback (ffffffffc1490c20) 00000100:00100000:1.0:1789762787.807617:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254880512:0@lo:103: 10000000:00010000:2.0:1789762787.807622:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.807623:0:6925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789762787.807639:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.807639:0:6925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:8794:x1876702254880256:12345-0@lo:104: Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.807656:0:6925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 10000000:00010000:2.0:1789762787.807657:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807665:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789762787.807672:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789762787.807685:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789762787.807693:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.807701:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee400 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:3.0:1789762787.807707:0:6926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807708:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807729:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762787.807747:0:6926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762787.807783:0:6926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.807794:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 9 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807795:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254880512 10000000:01000000:3.0:1789762787.807796:0:6926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789762787.807803:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807806:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254880512 00010000:00010000:2.0:1789762787.807821:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c1663800/0x5915dfb1c1b59161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59168 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.807823:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 9 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.807841:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 19 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807850:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789762787.807860:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807871:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cefc00 already unused, calling callback (ffffffffc1490c20) 00000100:00100000:0.0:1789762787.807875:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880768:192.168.203.36@tcp:104: 10000000:00010000:2.0:1789762787.807877:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.807884:0:6926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807890:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.807891:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789762787.807901:0:6926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789762787.807908:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254880512:12345-0@lo:103: 10000000:00010000:2.0:1789762787.807909:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762787.807923:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789762787.807930:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762787.807930:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.807942:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 19 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.807944:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b59145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5914c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807945:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807972:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789762787.807973:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 19 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.807986:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.807987:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762787.807994:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.807998:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762787.808000:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5913e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.808007:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c0030000 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:3.0:1789762787.808015:0:6926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.808017:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 19 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808022:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762787.808035:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762787.808038:0:6926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808041:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762787.808043:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 19 pid: 5920 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.808055:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254880512:12345-0@lo:103: Request processed in 146us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.808062:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254881152:0@lo:104: 00000100:00100000:1.0:1789762787.808075:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789762787.808096:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.808115:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762787.808130:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881152 00010000:00010000:0.0:1789762787.808131:0:8794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.808134:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254880640:0@lo:103: 00000100:00100000:2.0:1789762787.808137:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881152 00010000:00010000:0.0:1789762787.808153:0:8794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 18 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.808164:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254881280:0@lo:104: 00000100:00100000:2.0:1789762787.808175:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789762787.808186:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:8794:x1876702254881152:12345-0@lo:104: 00010000:00010000:2.0:1789762787.808198:0:7991:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.808205:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.808209:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.808244:0:8794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feacad80 going to sleep for 11 seconds 00010000:00010000:0.0:1789762787.808266:0:8794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33fec91600/0x5915dfb1c1b59192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b5918b expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.808272:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254880640 00000100:00100000:1.0:1789762787.808278:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254880640 00000100:00100000:0.0:1789762787.808282:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254879744:0@lo:104: 00010000:00010000:2.0:1789762787.808297:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1789762787.808298:0:6926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.808300:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254879872:0@lo:104: 00000100:00100000:2.0:1789762787.808313:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:8794:x1876702254881152:12345-0@lo:104: Request processed in 125us (213us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762787.808318:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.808321:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880000:0@lo:104: 10000000:01000000:3.0:1789762787.808329:0:6926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789762787.808340:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789762787.808345:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880128:0@lo:104: 00000100:00100000:2.0:1789762787.808370:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881280 00000100:00100000:0.0:1789762787.808372:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880256:0@lo:104: 00000100:00100000:2.0:1789762787.808378:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881280 00010000:00010000:3.0:1789762787.808378:0:6926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.808384:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789762787.808400:0:6926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789762787.808405:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:3419:x1876702254880640:12345-0@lo:103: 00000100:00100000:0.0:1789762787.808416:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254881152:0@lo:104: 00010000:00010000:1.0:1789762787.808417:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762787.808422:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789762787.808423:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.808428:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.808444:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:8794:x1876702254881280:12345-0@lo:104: 00010000:00010000:3.0:1789762787.808459:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b59129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59130 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.808462:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808465:0:7991:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.808500:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59161 expref: 18 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.808502:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762787.808528:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.808536:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762787.808554:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789762787.808561:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90e00 already unused, calling callback (ffffffffc1490c20) 00000100:00100000:2.0:1789762787.808564:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:8794:x1876702254881280:12345-0@lo:104: Request processed in 126us (361us total) trans 0 rc 0/0 10000000:00010000:3.0:1789762787.808570:0:6926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.808577:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789762787.808589:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254881280:0@lo:104: 00000100:00100000:1.0:1789762787.808594:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:3419:x1876702254880640:12345-0@lo:103: Request processed in 192us (394us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762787.808599:0:6926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.808614:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:00010000:3.0:1789762787.808618:0:6926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808619:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762787.808627:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808636:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec91800 already unused, calling callback (ffffffffc1490c20) 10000000:00010000:2.0:1789762787.808646:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808654:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762787.808661:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762787.808666:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789762787.808675:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254880512:0@lo:103: 00010000:00010000:2.0:1789762787.808694:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808701:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789762787.808705:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789762787.808713:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.808722:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254881536:0@lo:103: 00010000:00010000:2.0:1789762787.808724:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b5908f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b59096 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808796:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762787.808799:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762787.808802:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762787.808844:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.808877:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881536 00000100:00100000:2.0:1789762787.808882:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881536 00000100:00100000:1.0:1789762787.808904:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254881408:0@lo:103: 00010000:00010000:2.0:1789762787.808905:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 17 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762787.808928:0:6926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789762787.808944:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762787.808958:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762787.808958:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:3420:x1876702254881536:12345-0@lo:103: 00010000:00010000:3.0:1789762787.808972:0:6926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.808973:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762787.808990:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 17 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.808990:0:6926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789762787.809004:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880384:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762787.809005:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 17 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.809027:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8794:1876702254880768:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762787.809028:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b59096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b5908f expref: 17 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.809030:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881408 00000100:00100000:1.0:1789762787.809042:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881408 00010000:00010000:2.0:1789762787.809048:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762787.809064:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.809073:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 17 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.809081:0:8794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.809082:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33fec90e00/0x5915dfb1c1b590b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b590c0 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.809096:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:3420:x1876702254881536:12345-0@lo:103: Request processed in 140us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762787.809120:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789762787.809138:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762787.809146:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762787.809147:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789762787.809154:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762787.809163:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:3420:x1876702254881408:12345-0@lo:103: 00010000:00010000:2.0:1789762787.809172:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762787.809174:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762787.809179:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 16 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.809189:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 16 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.809200:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254880896:0@lo:103: 00010000:00010000:2.0:1789762787.809206:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0ceec00/0x5915dfb1c1b59130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59129 expref: 16 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.809215:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254880640:0@lo:103: 00010000:00010000:2.0:1789762787.809227:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762787.809256:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762787.809275:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:3420:x1876702254881408:12345-0@lo:103: Request processed in 116us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762787.809285:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789762787.809288:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473216 00000100:00100000:0.0:1789762787.809294:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473216 00010000:00010000:0.0:1789762787.809317:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 10 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.809329:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762787.809335:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254881536:0@lo:103: 00000100:00100000:1.0:1789762787.809355:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254881408:0@lo:103: 00000100:00100000:0.0:1789762787.809360:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254880896 00000100:00100000:0.0:1789762787.809367:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254880896 00000100:00100000:2.0:1789762787.809373:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1789762787.809381:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254881664:0@lo:103: 00010000:00010000:0.0:1789762787.809395:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 15 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.809398:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2354:x1876702246473216:12345-192.168.203.36@tcp:103: 00000100:00100000:1.0:1789762787.809407:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254881024:0@lo:103: 00010000:00010000:2.0:1789762787.809419:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762787.809428:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 10 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.809440:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 10 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.809454:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789762787.809455:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c0030c00/0x5915dfb1c1b590ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442dd expref: 10 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762787.809461:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762787.809474:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:3417:x1876702254880896:12345-0@lo:103: 00000100:00100000:1.0:1789762787.809475:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762787.809476:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762787.809492:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762787.809502:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 15 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.809520:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 15 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.809529:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:2354:x1876702246473216:12345-192.168.203.36@tcp:103: Request processed in 134us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762787.809535:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881664 00000100:00100000:1.0:1789762787.809560:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881664 00000100:00100000:2.0:1789762787.809567:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00010000:00010000:0.0:1789762787.809568:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33fec91200/0x5915dfb1c1b5914c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59145 expref: 15 pid: 5917 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.809587:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881024 00010000:00010000:1.0:1789762787.809591:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 16 pid: 5920 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762787.809597:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881024 00000100:00100000:3.0:1789762787.809612:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1789762787.809613:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762787.809623:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 16 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.809645:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473344 00000100:00100000:2.0:1789762787.809653:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789762787.809654:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473344 00000100:00100000:2.0:1789762787.809667:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:3417:x1876702254881664:12345-0@lo:103: 00010000:00010000:2.0:1789762787.809679:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762787.809685:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 16 pid: 5920 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.809706:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 9 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762787.809710:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:3417:x1876702254880896:12345-0@lo:103: Request processed in 222us (366us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762787.809729:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 16 pid: 5920 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.809798:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cefe00/0x5915dfb1c1b590c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b590b9 expref: 16 pid: 5920 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762787.809809:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762787.809842:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:3417:x1876702254881664:12345-0@lo:103: Request processed in 183us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762787.809900:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789762787.809912:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789762787.809922:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789762787.809930:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:3418:x1876702254881024:12345-0@lo:103: 00000100:00100000:1.0:1789762787.809932:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00010000:00010000:3.0:1789762787.809953:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762787.809954:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6183be2-02c3-467f-81fa-2ef6138a604e+9:2353:x1876702246473344:12345-192.168.203.36@tcp:103: 00010000:00010000:3.0:1789762787.809984:0:7992:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 13 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.809987:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762787.809999:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 9 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810014:0:7992:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 13 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.810033:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 9 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810053:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b5913e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59137 expref: 13 pid: 5919 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.810059:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c0031200/0x5915dfb1c1b590f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789442e4 expref: 9 pid: 5919 timeout: 190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810075:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810091:0:7992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762787.810102:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762787.810110:0:7992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810124:0:7992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810136:0:7992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.810149:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6183be2-02c3-467f-81fa-2ef6138a604e+8:2353:x1876702246473344:12345-192.168.203.36@tcp:103: Request processed in 201us (544us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762787.810151:0:7992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.810163:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00010000:00010000:3.0:1789762787.810186:0:7992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762787.810210:0:7992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810222:0:7992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810247:0:7992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.810259:0:8794:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762787.810262:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762787.810264:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254880896:0@lo:103: 00010000:00010000:0.0:1789762787.810275:0:8794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762787.810283:0:8794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0ceea00/0x5915dfb1c1b59199 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762787.810292:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254881664:0@lo:103: 00000100:00100000:3.0:1789762787.810381:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:3418:x1876702254881024:12345-0@lo:103: Request processed in 459us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762787.810389:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789762787.810416:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254881024:0@lo:103: 00010000:00010000:2.0:1789762788.218919:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789762788.986829:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789762788.986837:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33fecdc800 from 39 10000000:01000000:0.0:1789762788.986843:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789762788.986895:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef600/0x5915dfb1c1b591a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.986909:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef600/0x5915dfb1c1b591a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.986921:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef600/0x5915dfb1c1b591a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.986947:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254881792:0@lo:101: 00000100:00100000:0.0:1789762788.987019:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.987090:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.987090:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881792 00000100:00100000:3.0:1789762788.987101:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881792 00000100:00100000:3.0:1789762788.987151:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789762788.987161:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+12:5922:x1876702254881792:12345-0@lo:101: 00010000:00010000:3.0:1789762788.987173:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762788.987185:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b591a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b591a0 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.987204:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b591a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b591a0 expref: 13 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.987212:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90200/0x5915dfb1c1b591a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b591a0 expref: 13 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.987220:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90200, rc 0) 00000100:00100000:3.0:1789762788.987270:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254881792:12345-0@lo:101: Request processed in 111us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.987275:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789762788.987323:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254881792:0@lo:101: 00010000:00010000:0.0:1789762788.987347:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef600/0x5915dfb1c1b591a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591a7 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.987358:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef600/0x5915dfb1c1b591a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b591a7 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.987422:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254881920:0@lo:501: 00000100:00100000:0.0:1789762788.987452:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.987474:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.987491:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254881920 00000100:00100000:3.0:1789762788.987495:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254881920 00000100:00100000:3.0:1789762788.987515:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789762788.987520:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254881920:12345-0@lo:501: 00000100:00100000:3.0:1789762788.987611:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254881920:12345-0@lo:501: Request processed in 90us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.987616:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789762788.987646:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254881920:0@lo:501: 00000100:00100000:0.0:1789762788.987668:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882048:0@lo:503: 00000100:00100000:0.0:1789762788.987700:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.987715:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.987747:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882048 00000100:00100000:3.0:1789762788.987774:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882048 00000100:00100000:3.0:1789762788.987802:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789762788.987810:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254882048:12345-0@lo:503: 00000100:00100000:3.0:1789762788.987891:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254882048:12345-0@lo:503: Request processed in 83us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.987897:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789762788.987922:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882048:0@lo:503: 00000100:00100000:0.0:1789762788.988172:0:8810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8810:1876702254882176:0@lo:502: 00000100:00100000:0.0:1789762788.988206:0:8810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.988226:0:8810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca900 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.988247:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882176 00000100:00100000:3.0:1789762788.988251:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882176 00000100:00100000:3.0:1789762788.988272:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789762788.988276:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:8810:x1876702254882176:12345-0@lo:502: 00000100:00100000:3.0:1789762788.988349:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:8810:x1876702254882176:12345-0@lo:502: Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.988358:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789762788.988375:0:8810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8810:1876702254882176:0@lo:502: 00000100:00100000:0.0:1789762788.988409:0:8810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8810:1876702254882304:0@lo:502: 00000100:00100000:0.0:1789762788.988434:0:8810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.988448:0:8810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca900 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.988468:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882304 00000100:00100000:3.0:1789762788.988472:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882304 00000100:00100000:3.0:1789762788.988492:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789762788.988496:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:8810:x1876702254882304:12345-0@lo:502: 00000100:00100000:3.0:1789762788.988556:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:8810:x1876702254882304:12345-0@lo:502: Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.988562:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789762788.988574:0:8810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8810:1876702254882304:0@lo:502: 00000040:00080000:0.0:1789762788.988596:0:8810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789762788.988656:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789762788.988680:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789762788.988687:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef600/0x5915dfb1c1b591a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591a7 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.988695:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef600/0x5915dfb1c1b591a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591a7 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762788.988701:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789762788.988703:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789762788.988704:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789762788.988718:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030c00/0x5915dfb1c1b591ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.988739:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c0030c00/0x5915dfb1c1b591ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.988745:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c0030c00/0x5915dfb1c1b591ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762788.988777:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882432:0@lo:101: 00000100:00100000:2.0:1789762788.988812:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.988835:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70600 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.988856:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882432 00000100:00100000:3.0:1789762788.988860:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882432 00000100:00100000:3.0:1789762788.988880:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789762788.988886:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+13:5922:x1876702254882432:12345-0@lo:101: 00010000:00010000:3.0:1789762788.988892:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762788.988898:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90e00/0x5915dfb1c1b591b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b591ae expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.988909:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90e00/0x5915dfb1c1b591b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b591ae expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.988915:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90e00/0x5915dfb1c1b591b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b591ae expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.988919:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90e00, rc 0) 00000100:00100000:3.0:1789762788.988946:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254882432:12345-0@lo:101: Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.988951:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789762788.988960:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882432:0@lo:101: 00010000:00010000:2.0:1789762788.988972:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c0030c00/0x5915dfb1c1b591ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591b5 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.988979:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c0030c00/0x5915dfb1c1b591ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b591b5 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762788.989020:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882560:0@lo:501: 00000100:00100000:2.0:1789762788.989049:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.989067:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70600 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.989084:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882560 00000100:00100000:3.0:1789762788.989088:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882560 00000100:00100000:3.0:1789762788.989112:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789762788.989122:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254882560:12345-0@lo:501: 00000100:00100000:3.0:1789762788.989189:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254882560:12345-0@lo:501: Request processed in 69us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.989194:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789762788.989199:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882560:0@lo:501: 00000100:00100000:2.0:1789762788.989227:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882688:0@lo:503: 00000100:00100000:2.0:1789762788.989256:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.989274:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70600 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.989288:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882688 00000100:00100000:3.0:1789762788.989292:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882688 00000100:00100000:3.0:1789762788.989310:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789762788.989316:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254882688:12345-0@lo:503: 00000100:00100000:3.0:1789762788.989367:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254882688:12345-0@lo:503: Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.989372:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789762788.989395:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254882688:0@lo:503: 00000100:00100000:2.0:1789762788.989626:0:8811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8811:1876702254882816:0@lo:502: 00000100:00100000:2.0:1789762788.989663:0:8811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.989684:0:8811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.989695:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882816 00000100:00100000:3.0:1789762788.989699:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882816 00000100:00100000:3.0:1789762788.989718:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789762788.989735:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8811:x1876702254882816:12345-0@lo:502: 00000100:00100000:3.0:1789762788.989819:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8811:x1876702254882816:12345-0@lo:502: Request processed in 96us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.989825:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789762788.989851:0:8811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8811:1876702254882816:0@lo:502: 00000020:01000000:2.0:1789762788.989876:0:8811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762788.989885:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762788.989888:0:8811:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789762788.989894:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789762788.989917:0:8811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8811:1876702254882944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762788.989959:0:8811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.989985:0:8811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.989994:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254882944 00000100:00100000:3.0:1789762788.989998:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254882944 00000100:00100000:3.0:1789762788.990019:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789762788.990025:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8811:x1876702254882944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.990091:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:8811:x1876702254882944:12345-0@lo:502:llog_process_th.0 Request processed in 65us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.990100:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789762788.990105:0:8811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8811:1876702254882944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762788.990125:0:8811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762788.990129:0:8811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762788.990131:0:8811:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789762788.990133:0:8811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789762788.990191:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789762788.990210:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789762788.990220:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030c00/0x5915dfb1c1b591ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591b5 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.990227:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c0030c00/0x5915dfb1c1b591ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591b5 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762788.990233:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789762788.990234:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33f46f3000 from 39 10000000:01000000:0.0:1789762788.990236:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789762788.990249:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceea00/0x5915dfb1c1b591bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.990254:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceea00/0x5915dfb1c1b591bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.990260:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceea00/0x5915dfb1c1b591bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.990269:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.990291:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.990308:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca900 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.990328:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883072 00000100:00100000:3.0:1789762788.990333:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883072 00000100:00100000:3.0:1789762788.990362:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789762788.990371:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+14:5922:x1876702254883072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762788.990379:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762788.990386:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90600/0x5915dfb1c1b591c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b591bc expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.990402:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90600/0x5915dfb1c1b591c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b591bc expref: 15 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.990408:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90600/0x5915dfb1c1b591c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b591bc expref: 15 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.990413:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90600, rc 0) 00000100:00100000:3.0:1789762788.990440:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254883072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.990444:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789762788.990483:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789762788.990497:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceea00/0x5915dfb1c1b591bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591c3 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.990507:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceea00/0x5915dfb1c1b591bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b591c3 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.990547:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.990585:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.990604:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca900 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.990622:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883200 00000100:00100000:3.0:1789762788.990626:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883200 00000100:00100000:3.0:1789762788.990646:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789762788.990650:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254883200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.990700:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254883200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.990708:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789762788.990742:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.990796:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.990834:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762788.990865:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883328 00000100:00100000:0.0:1789762788.990867:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca900 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.990869:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883328 00000100:00100000:3.0:1789762788.990892:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789762788.990897:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254883328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.990947:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254883328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.990953:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789762788.990967:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.991134:0:8812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8812:1876702254883456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762788.991171:0:8812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.991190:0:8812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feacad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.991208:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883456 00000100:00100000:3.0:1789762788.991212:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883456 00000100:00100000:3.0:1789762788.991237:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789762788.991242:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8812:x1876702254883456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.991293:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8812:x1876702254883456:12345-0@lo:502:llog_process_th.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.991298:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789762788.991317:0:8812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8812:1876702254883456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762788.991356:0:8812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8812:1876702254883584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762788.991390:0:8812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.991410:0:8812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feacad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.991412:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883584 00000100:00100000:3.0:1789762788.991416:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883584 00000100:00100000:3.0:1789762788.991438:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789762788.991446:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8812:x1876702254883584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.991513:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:8812:x1876702254883584:12345-0@lo:502:llog_process_th.0 Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.991520:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789762788.991535:0:8812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8812:1876702254883584:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789762788.991559:0:8812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789762788.991598:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789762788.991618:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789762788.991624:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceea00/0x5915dfb1c1b591bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591c3 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.991632:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0ceea00/0x5915dfb1c1b591bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591c3 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762788.991637:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789762788.991638:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789762788.991640:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789762788.991654:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b591ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.991661:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b591ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.991669:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b591ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762788.991684:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.991712:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.991747:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.991781:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883712 00000100:00100000:3.0:1789762788.991786:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883712 00000100:00100000:3.0:1789762788.991808:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789762788.991813:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+15:5922:x1876702254883712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762788.991819:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762788.991824:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec91400/0x5915dfb1c1b591d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b591ca expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.991834:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec91400/0x5915dfb1c1b591d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b591ca expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.991840:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec91400/0x5915dfb1c1b591d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b591ca expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.991845:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec91400, rc 0) 00000100:00100000:3.0:1789762788.991871:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254883712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762788.991879:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.991884:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00010000:2.0:1789762788.991892:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b591ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591d1 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.991900:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b591ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b591d1 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762788.991929:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.991949:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.991973:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.991975:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883840 00000100:00100000:3.0:1789762788.991980:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883840 00000100:00100000:3.0:1789762788.992000:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789762788.992005:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254883840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.992054:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254883840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.992060:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789762788.992072:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.992093:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.992120:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.992133:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.992148:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254883968 00000100:00100000:3.0:1789762788.992153:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254883968 00000100:00100000:3.0:1789762788.992179:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789762788.992187:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254883968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.992255:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254883968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762788.992260:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254883968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.992264:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789762788.992431:0:8813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8813:1876702254884096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762788.992467:0:8813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.992485:0:8813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.992495:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884096 00000100:00100000:3.0:1789762788.992499:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884096 00000100:00100000:3.0:1789762788.992518:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789762788.992523:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8813:x1876702254884096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.992577:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8813:x1876702254884096:12345-0@lo:502:llog_process_th.0 Request processed in 53us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.992583:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789762788.992592:0:8813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8813:1876702254884096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762788.992618:0:8813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762788.992624:0:8813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762788.992626:0:8813:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789762788.992630:0:8813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789762788.992645:0:8813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8813:1876702254884224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762788.992675:0:8813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.992688:0:8813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.992701:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884224 00000100:00100000:3.0:1789762788.992705:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884224 00000100:00100000:3.0:1789762788.992739:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789762788.992748:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8813:x1876702254884224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.992852:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:8813:x1876702254884224:12345-0@lo:502:llog_process_th.0 Request processed in 106us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.992858:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789762788.992863:0:8813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8813:1876702254884224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762788.992882:0:8813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762788.992886:0:8813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762788.992887:0:8813:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789762788.992890:0:8813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789762788.992938:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789762788.992956:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789762788.992962:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b591ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591d1 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.992971:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c0030000/0x5915dfb1c1b591ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591d1 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762788.992991:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789762788.992993:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b33c8a8a800 from 39 10000000:01000000:0.0:1789762788.992996:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789762788.993011:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b591d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.993018:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b591d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.993026:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b591d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.993038:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.993066:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.993093:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feacad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.993097:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884352 00000100:00100000:3.0:1789762788.993101:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884352 00000100:00100000:3.0:1789762788.993121:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789762788.993126:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254884352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762788.993132:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762788.993138:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec91c00/0x5915dfb1c1b591df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b591d8 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.993147:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec91c00/0x5915dfb1c1b591df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b591d8 expref: 17 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.993153:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec91c00/0x5915dfb1c1b591df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b591d8 expref: 17 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.993158:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec91c00, rc 0) 00000100:00100000:3.0:1789762788.993181:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254884352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.993185:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789762788.993208:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789762788.993220:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b591d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591df expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.993229:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b591d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b591df expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.993264:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.993291:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.993309:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feacad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.993313:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884480 00000100:00100000:3.0:1789762788.993317:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884480 00000100:00100000:3.0:1789762788.993336:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789762788.993341:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254884480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.993389:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254884480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.993403:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789762788.993409:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.993437:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.993476:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.993494:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feacad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.993504:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884608 00000100:00100000:3.0:1789762788.993508:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884608 00000100:00100000:3.0:1789762788.993527:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789762788.993533:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254884608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.993581:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254884608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.993586:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789762788.993604:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.993819:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8814:1876702254884736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762788.993856:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762788.993891:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884736 00000100:00100000:3.0:1789762788.993895:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884736 00000100:00100000:0.0:1789762788.993896:0:8814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.993919:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789762788.993925:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8814:x1876702254884736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.993976:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8814:x1876702254884736:12345-0@lo:502:llog_process_th.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.993982:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789762788.993999:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8814:1876702254884736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762788.994039:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8814:1876702254884864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762788.994075:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.994094:0:8814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.994106:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884864 00000100:00100000:3.0:1789762788.994111:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884864 00000100:00100000:3.0:1789762788.994138:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789762788.994147:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8814:x1876702254884864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.994200:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8814:x1876702254884864:12345-0@lo:502:llog_process_th.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.994205:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789762788.994223:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8814:1876702254884864:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789762788.994247:0:8814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789762788.994284:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789762788.994304:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789762788.994309:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b591d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591df expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.994317:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cee400/0x5915dfb1c1b591d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591df expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762788.994323:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789762788.994324:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789762788.994326:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789762788.994338:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0031200/0x5915dfb1c1b591e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.994342:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c0031200/0x5915dfb1c1b591e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.994348:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c0031200/0x5915dfb1c1b591e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762788.994357:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.994376:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.994397:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.994418:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254884992 00000100:00100000:3.0:1789762788.994422:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254884992 00000100:00100000:3.0:1789762788.994441:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789762788.994446:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254884992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762788.994456:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762788.994462:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90800/0x5915dfb1c1b591ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b591e6 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.994472:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90800/0x5915dfb1c1b591ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b591e6 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.994478:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90800/0x5915dfb1c1b591ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b591e6 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.994483:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90800, rc 0) 00000100:00100000:3.0:1789762788.994507:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254884992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.994512:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789762788.994520:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254884992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762788.994532:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c0031200/0x5915dfb1c1b591e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591ed expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762788.994539:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c0031200/0x5915dfb1c1b591e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b591ed expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762788.994565:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.994583:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.994594:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.994613:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254885120 00000100:00100000:3.0:1789762788.994617:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254885120 00000100:00100000:3.0:1789762788.994636:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789762788.994641:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254885120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.994699:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254885120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762788.994703:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.994711:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789762788.994747:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.994807:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762788.994838:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254885248 00000100:00100000:2.0:1789762788.994841:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70780 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.994842:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254885248 00000100:00100000:3.0:1789762788.994867:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789762788.994872:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254885248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.994924:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254885248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.994935:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789762788.994943:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762788.995109:0:8815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8815:1876702254885376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762788.995135:0:8815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.995148:0:8815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70540 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.995163:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254885376 00000100:00100000:3.0:1789762788.995167:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254885376 00000100:00100000:3.0:1789762788.995186:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789762788.995192:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8815:x1876702254885376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.995248:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8815:x1876702254885376:12345-0@lo:502:llog_process_th.0 Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.995255:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789762788.995257:0:8815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8815:1876702254885376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762788.995281:0:8815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762788.995285:0:8815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762788.995287:0:8815:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789762788.995290:0:8815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789762788.995302:0:8815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8815:1876702254885504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762788.995332:0:8815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762788.995345:0:8815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fee70540 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.995354:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254885504 00000100:00100000:3.0:1789762788.995358:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254885504 00000100:00100000:3.0:1789762788.995376:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789762788.995382:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8815:x1876702254885504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762788.995438:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8815:x1876702254885504:12345-0@lo:502:llog_process_th.0 Request processed in 55us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.995444:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789762788.995450:0:8815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8815:1876702254885504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762788.995475:0:8815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762788.995480:0:8815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762788.995481:0:8815:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789762788.995485:0:8815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789762788.995537:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789762788.995556:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789762788.995562:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c0031200/0x5915dfb1c1b591e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591ed expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.995571:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c0031200/0x5915dfb1c1b591e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591ed expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762788.995580:0:5922:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789762788.995582:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b33d8ce99b8 from 1 10000000:01000000:0.0:1789762788.995585:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789762788.995600:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefe00/0x5915dfb1c1b591f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.995619:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefe00/0x5915dfb1c1b591f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.995629:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefe00/0x5915dfb1c1b591f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.995643:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.995670:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762788.995694:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.995711:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254885632 00000100:00100000:3.0:1789762788.995714:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254885632 00000100:00100000:3.0:1789762788.995771:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789762788.995782:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254885632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762788.995788:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762788.995794:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90a00/0x5915dfb1c1b591fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b591f4 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.995804:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90a00/0x5915dfb1c1b591fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b591f4 expref: 19 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.995810:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90a00/0x5915dfb1c1b591fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b591f4 expref: 19 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762788.995820:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90a00, rc 0) 00000100:00100000:3.0:1789762788.995846:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254885632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762788.995850:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789762788.995879:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789762788.995890:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefe00/0x5915dfb1c1b591f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591fb expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.995899:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefe00/0x5915dfb1c1b591f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b591fb expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762788.995936:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762788.995961:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762788.995988:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254885760 00000100:00100000:3.0:1789762788.995991:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254885760 00000100:00100000:0.0:1789762788.995992:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762788.996014:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789762788.996018:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254885760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762788.996055:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254885760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 36us (94us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789762788.996060:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789762788.996080:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254885760:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789762788.996101:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789762788.996106:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefe00/0x5915dfb1c1b591f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591fb expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762788.996114:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefe00/0x5915dfb1c1b591f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b591fb expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762789.178937:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254885888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762789.179000:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762789.179052:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254885888 00000100:00100000:0.0:1789762789.179062:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254885888 00000100:00080000:2.0:1789762789.179107:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762789.179132:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789762789.179145:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254885888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762789.179173:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762789.179230:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254885888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762789.179248:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789762789.179271:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f463dc00 x1876702254885888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762789.179292:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254885888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762789.242902:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762789.251822:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.251864:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762789.251895:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473600 00000100:00100000:3.0:1789762789.251896:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762789.251907:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473600 00000100:00100000:1.0:1789762789.251914:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473472 00000100:00100000:1.0:1789762789.251920:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473472 00000100:00100000:3.0:1789762789.251934:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762789.251956:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473728 00000100:00100000:2.0:1789762789.251962:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473728 00000100:00100000:1.0:1789762789.251968:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:3.0:1789762789.251980:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473856 00000100:00100000:0.0:1789762789.251984:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:1.0:1789762789.251984:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+8:2354:x1876702246473472:12345-192.168.203.36@tcp:400: 00000100:00100000:3.0:1789762789.251987:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473856 00000100:00100000:0.0:1789762789.252003:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246473600:12345-192.168.203.36@tcp:400: 00000100:00100000:2.0:1789762789.252007:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:2.0:1789762789.252021:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246473728:12345-192.168.203.36@tcp:400: 00000100:00100000:3.0:1789762789.252035:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:3.0:1789762789.252045:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246473856:12345-192.168.203.36@tcp:400: 00000100:00100000:1.0:1789762789.252060:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+8:2354:x1876702246473472:12345-192.168.203.36@tcp:400: Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762789.252068:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246473600:12345-192.168.203.36@tcp:400: Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762789.252069:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246473728:12345-192.168.203.36@tcp:400: Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762789.252075:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:3.0:1789762789.252080:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246473856:12345-192.168.203.36@tcp:400: Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762789.252091:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:0.0:1789762789.252093:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1789762789.252098:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00080000:0.0:1789762789.252158:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762789.252165:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762789.252169:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762789.571807:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.571856:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246473984 00000100:00100000:3.0:1789762789.571866:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246473984 00000100:00100000:3.0:1789762789.571923:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:3.0:1789762789.571932:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+8:5433:x1876702246473984:12345-192.168.203.36@tcp:101: 00010000:00010000:3.0:1789762789.571948:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762789.571962:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec91000/0x5915dfb1c1b59202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b878944346 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762789.571986:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec91000/0x5915dfb1c1b59202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944346 expref: 9 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762789.571994:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec91000/0x5915dfb1c1b59202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944346 expref: 9 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762789.572002:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec91000, rc 0) 00000100:00100000:3.0:1789762789.572051:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5433:x1876702246473984:12345-192.168.203.36@tcp:101: Request processed in 121us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762789.572057:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:2.0:1789762789.572971:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.573010:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246474112 00000100:00100000:3.0:1789762789.573015:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246474112 00000100:00100000:3.0:1789762789.573040:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:3.0:1789762789.573046:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5433:x1876702246474112:12345-192.168.203.36@tcp:501: 00000100:00100000:3.0:1789762789.573147:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5433:x1876702246474112:12345-192.168.203.36@tcp:501: Request processed in 101us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762789.573153:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:0.0:1789762789.573865:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.573901:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246474240 00000100:00100000:3.0:1789762789.573905:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246474240 00000100:00100000:3.0:1789762789.573927:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:3.0:1789762789.573932:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5433:x1876702246474240:12345-192.168.203.36@tcp:503: 00000100:00100000:3.0:1789762789.574003:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5433:x1876702246474240:12345-192.168.203.36@tcp:503: Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762789.574008:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:0.0:1789762789.575113:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.575207:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246474368 00000100:00100000:3.0:1789762789.575222:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246474368 00000100:00100000:3.0:1789762789.575272:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:3.0:1789762789.575286:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5904:x1876702246474368:12345-192.168.203.36@tcp:502: 00000100:00100000:3.0:1789762789.575419:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5904:x1876702246474368:12345-192.168.203.36@tcp:502: Request processed in 138us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762789.575426:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:2.0:1789762789.576196:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.576226:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246474496 00000100:00100000:3.0:1789762789.576231:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246474496 00000100:00100000:3.0:1789762789.576257:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:3.0:1789762789.576263:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5904:x1876702246474496:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789762789.576331:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5904:x1876702246474496:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762789.576337:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:0.0:1789762789.577361:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.577424:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246474624 00000100:00100000:3.0:1789762789.577429:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246474624 00000100:00100000:3.0:1789762789.577456:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:3.0:1789762789.577461:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5433:x1876702246474624:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762789.577469:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762789.577491:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec91a00/0x5915dfb1c1b59209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b87894434d expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762789.577517:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec91a00/0x5915dfb1c1b59209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894434d expref: 10 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762789.577538:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec91a00/0x5915dfb1c1b59209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894434d expref: 10 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762789.577549:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec91a00, rc 0) 00000100:00100000:3.0:1789762789.577582:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246474624:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 119us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762789.577587:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:0.0:1789762789.578383:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762789.578423:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246474752 00000100:00100000:3.0:1789762789.578428:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246474752 00000100:00100000:3.0:1789762789.578450:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 163 00000100:00100000:3.0:1789762789.578456:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246474752:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762789.578523:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246474752:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 66us (142us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789762789.578533:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 163 00000001:00100000:0.0:1789762789.691663:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:1.0:1789762790.173121:0:8852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcd0b1e90 20000000:00000080:1.0:1789762790.173134:0:8852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b33f74ae800 uarg=0000000000000000 20000000:01000000:1.0:1789762790.173167:0:8852:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789762790.173172:0:8852:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789762790.173180:0:8852:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789762790.173533:0:8853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789762790.173632:0:8852:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789762790.175893:0:8852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789762790.175914:0:8852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789762790.175924:0:8852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789762790.175933:0:8852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789762790.175948:0:8852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.175962:0:8852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cef000/0x5915dfb1c1b58f85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.175968:0:8852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.175973:0:8852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.175979:0:8852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 9 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.175984:0:8852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.176017:0:8852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 9 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.176028:0:8852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 9 pid: 5920 timeout: 192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.176041:0:8852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886016:192.168.203.36@tcp:104: 00010000:00010000:1.0:1789762790.176148:0:8852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.176162:0:8852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 18 pid: 5919 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.176173:0:8852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886144:0@lo:104: 00000100:00100000:1.0:1789762790.176205:0:8852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762790.176253:0:8852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762790.176256:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254886144 00000100:00100000:3.0:1789762790.176265:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254886144 00010000:00010000:1.0:1789762790.176272:0:8852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 18 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.176285:0:8852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886272:0@lo:104: 00000100:00100000:1.0:1789762790.176324:0:8852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.176350:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254886272 00000100:00100000:3.0:1789762790.176357:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789762790.176361:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254886272 00010000:00010000:1.0:1789762790.176363:0:8852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f0cef000/0x5915dfb1c1b58f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762790.176372:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8852:x1876702254886144:12345-0@lo:104: 00010000:00010000:1.0:1789762790.176377:0:8852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f0cef000/0x5915dfb1c1b58f85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 18 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.176389:0:8852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886400:0@lo:104: 00010000:00010000:3.0:1789762790.176391:0:7991:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.176417:0:8852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46300 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.176418:0:5908:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789762790.176426:0:6925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789762790.176444:0:6925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7230050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8852:x1876702254886272:12345-0@lo:104: 00010000:00010000:0.0:1789762790.176466:0:6925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762790.176474:0:5908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789762790.176489:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762790.176493:0:8852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886144:0@lo:104: 00000100:00100000:3.0:1789762790.176504:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8852:x1876702254886144:12345-0@lo:104: Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.176513:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254886400 00000100:00100000:2.0:1789762790.176520:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254886400 00000100:00100000:3.0:1789762790.176521:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789762790.176562:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789762790.176564:0:6925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789762790.176574:0:6925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7230050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8852:x1876702254886272:12345-0@lo:104: Request processed in 135us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762790.176583:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+4:8852:x1876702254886400:12345-0@lo:104: 00000100:00100000:0.0:1789762790.176589:0:6925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789762790.176598:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.176611:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789762790.176628:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.176643:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec91e00 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:3.0:1789762790.176652:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762790.176662:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762790.176664:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.176669:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789762790.176686:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc1490c20) 00000100:00100000:0.0:1789762790.176688:0:8852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886272:0@lo:104: 00000100:00100000:1.0:1789762790.176688:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+3:8852:x1876702254886400:12345-0@lo:104: Request processed in 112us (221us total) trans 0 rc 0/0 10000000:00010000:3.0:1789762790.176698:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762790.176709:0:8852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886400:0@lo:104: 00000100:00100000:1.0:1789762790.176736:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789762790.176737:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.176741:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789762790.176776:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762790.176782:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789762790.176806:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762790.176819:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.176825:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789762790.176856:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.176861:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f0cef800/0x5915dfb1c1b58fe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58fe7 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.176871:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762790.176873:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762790.176875:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762790.176888:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254886528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789762790.176917:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762790.176962:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254886528 00010000:00010000:0.0:1789762790.176967:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762790.176973:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254886528 00010000:00010000:0.0:1789762790.176978:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.176989:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662000 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:3.0:1789762790.176993:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 19 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789762790.176995:0:6926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.177013:0:6926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789762790.177022:0:6926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762790.177022:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789762790.177032:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254886528:12345-0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789762790.177036:0:6926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789762790.177042:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762790.177068:0:6926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.177077:0:6926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789762790.177098:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.177112:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c1662000/0x5915dfb1c1b58f7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b58f85 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.177124:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762790.177128:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762790.177131:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762790.177132:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 19 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.177143:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 19 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.177153:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762790.177158:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762790.177159:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b34021f7800/0x5915dfb1c1b58fe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58fe0 expref: 19 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.177177:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1789762790.177216:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762790.177227:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789762790.177227:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:3419:x1876702254886528:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762790.177243:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789762790.177273:0:8852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8852:1876702254886016:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762790.177280:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762790.177284:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254886656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789762790.177294:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789762790.177305:0:8852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177322:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177329:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33fec91e00/0x5915dfb1c1b590ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b590b2 expref: -99 pid: 7981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.177333:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762790.177351:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254886784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789762790.177356:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762790.177360:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762790.177366:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762790.177402:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.177420:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254886528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789762790.177448:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254886656 00000100:00100000:0.0:1789762790.177454:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254886656 00010000:00010000:0.0:1789762790.177472:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cef000/0x5915dfb1c1b58f85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 18 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762790.177485:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762790.177505:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254886784 00000100:00100000:0.0:1789762790.177509:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254886784 00010000:00010000:0.0:1789762790.177522:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 19 pid: 5919 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762790.177527:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789762790.177548:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789762790.177562:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254886784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789762790.177573:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762790.177579:0:7992:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 19 pid: 5919 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762790.177587:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762790.177596:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254886656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789762790.177597:0:7992:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 19 pid: 5919 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.177617:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cef200/0x5915dfb1c1b590b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b590ab expref: 19 pid: 5919 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.177617:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762790.177629:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f0cef000/0x5915dfb1c1b58f85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 18 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.177636:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762790.177639:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246474880 00000100:00100000:2.0:1789762790.177645:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246474880 00010000:00010000:3.0:1789762790.177646:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f0cef000/0x5915dfb1c1b58f85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 18 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177673:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 10 pid: 5920 timeout: 192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.177676:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cef000/0x5915dfb1c1b58f85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b58f7e expref: 18 pid: 5917 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.177693:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:3418:x1876702254886784:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762790.177707:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789762790.177709:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762790.177731:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254886784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789762790.177742:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:2.0:1789762790.177810:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2354:x1876702246474880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789762790.177821:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:3420:x1876702254886656:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (417us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762790.177825:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762790.177835:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 10 pid: 5920 timeout: 192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762790.177836:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789762790.177863:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 10 pid: 5920 timeout: 192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762790.177881:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254886656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789762790.177885:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c0031a00/0x5915dfb1c1b590ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944315 expref: 10 pid: 5920 timeout: 192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177907:0:5954:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177917:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177933:0:5954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177942:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177950:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177958:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177965:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762790.177970:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.177987:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.178009:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.178025:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762790.178028:0:8852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.178036:0:8852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.178047:0:8852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b59210 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762790.178089:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6183be2-02c3-467f-81fa-2ef6138a604e+9:2354:x1876702246474880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 282us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.178103:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00010000:00010000:3.0:1789762790.266888:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789762790.298816:0:5922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789762790.298822:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33fecdc800 from 4 10000000:01000000:1.0:1789762790.298827:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789762790.298872:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.298898:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.298908:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.298929:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254886912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789762790.298991:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762790.299042:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46540 going to sleep for 11 seconds 00000100:00100000:3.0:1789762790.299057:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254886912 00000100:00100000:3.0:1789762790.299068:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254886912 00000100:00100000:3.0:1789762790.299122:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789762790.299131:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254886912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762790.299142:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762790.299155:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59217 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.299174:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 17 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.299182:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 17 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.299189:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec91800, rc 0) 00000100:00100000:3.0:1789762790.299226:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254886912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762790.299232:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789762790.299275:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254886912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789762790.299291:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762790.299302:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762790.299361:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789762790.299390:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762790.299404:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46540 going to sleep for 11 seconds 00000100:00100000:3.0:1789762790.299424:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887040 00000100:00100000:3.0:1789762790.299428:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887040 00000100:00100000:3.0:1789762790.299449:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789762790.299455:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254887040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762790.299548:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254887040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762790.299554:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789762790.299578:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789762790.299609:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789762790.299649:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762790.299664:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fec46540 going to sleep for 11 seconds 00000100:00100000:3.0:1789762790.299681:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887168 00000100:00100000:3.0:1789762790.299685:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887168 00000100:00100000:3.0:1789762790.299704:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789762790.299709:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254887168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762790.299824:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254887168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762790.299830:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789762790.299851:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762790.300221:0:8866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8866:1876702254887296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762790.300250:0:8866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762790.300271:0:8866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e0a52540 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.300313:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887296 00000100:00100000:2.0:1789762790.300326:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887296 00000100:00100000:2.0:1789762790.300377:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789762790.300386:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8866:x1876702254887296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.300540:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8866:x1876702254887296:12345-0@lo:502:llog_process_th.0 Request processed in 155us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.300546:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789762790.300619:0:8866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8866:1876702254887296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789762790.300643:0:8866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789762790.300652:0:8866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762790.300654:0:8866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789762790.300660:0:8866:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b33fecdc800 00000020:00000080:3.0:1789762790.300663:0:8866:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789762790.300744:0:8866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8866:1876702254887424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789762790.300802:0:8866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762790.300832:0:8866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e0a52540 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.300849:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887424 00000100:00100000:2.0:1789762790.300856:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887424 00000100:00100000:2.0:1789762790.300892:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789762790.300902:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8866:x1876702254887424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.300993:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:8866:x1876702254887424:12345-0@lo:502:llog_process_th.0 Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.301000:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789762790.301014:0:8866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8866:1876702254887424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789762790.301052:0:8866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789762790.301056:0:8866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789762790.301057:0:8866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789762790.301061:0:8866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789762790.301141:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789762790.301190:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789762790.301208:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.301231:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762790.301242:0:5922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789762790.301244:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33f46f3000 from 4 10000000:01000000:2.0:1789762790.301246:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789762790.301274:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.301281:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.301288:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762790.301305:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.301341:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.301366:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762790.301384:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887552 00000100:00100000:3.0:1789762790.301390:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887552 00000100:00100000:3.0:1789762790.301424:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789762790.301434:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254887552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762790.301442:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762790.301450:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59225 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.301463:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.301471:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762790.301475:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90400, rc 0) 00000100:00100000:3.0:1789762790.301511:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254887552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762790.301515:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789762790.301555:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762790.301569:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.301577:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762790.301646:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.301684:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.301724:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762790.301733:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887680 00000100:00100000:3.0:1789762790.301738:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887680 00000100:00100000:3.0:1789762790.301816:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789762790.301830:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254887680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762790.301910:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254887680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762790.301924:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789762790.301929:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.301970:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.302024:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762790.302054:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887808 00000100:00100000:3.0:1789762790.302059:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887808 00000100:00100000:2.0:1789762790.302060:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789762790.302089:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789762790.302098:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254887808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762790.302185:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254887808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762790.302192:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789762790.302227:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254887808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.302439:0:8868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8868:1876702254887936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.302480:0:8868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.302505:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254887936 00000100:00100000:2.0:1789762790.302509:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254887936 00000100:00100000:2.0:1789762790.302551:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789762790.302559:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8868:x1876702254887936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.302648:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8868:x1876702254887936:12345-0@lo:502:llog_process_th.0 Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.302654:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789762790.302705:0:8868:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.302735:0:8868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8868:1876702254887936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762790.302814:0:8868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762790.302822:0:8868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762790.302825:0:8868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789762790.302830:0:8868:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b33f46f3000 00000020:00000080:2.0:1789762790.302837:0:8868:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789762790.302901:0:8868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8868:1876702254888064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.302936:0:8868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.302964:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888064 00000100:00100000:2.0:1789762790.302973:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888064 00000100:00100000:2.0:1789762790.303003:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789762790.303015:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8868:x1876702254888064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.303099:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:8868:x1876702254888064:12345-0@lo:502:llog_process_th.0 Request processed in 89us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.303109:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789762790.303155:0:8868:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.303171:0:8868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8868:1876702254888064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762790.303206:0:8868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762790.303211:0:8868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762790.303213:0:8868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789762790.303219:0:8868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789762790.303295:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789762790.303330:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789762790.303336:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.303343:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789762790.303350:0:5922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789762790.303352:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33c8a8a800 from 4 10000000:01000000:2.0:1789762790.303354:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789762790.303372:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.303379:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.303385:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762790.303402:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254888192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.303434:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.303462:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.303491:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888192 00000100:00100000:2.0:1789762790.303494:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888192 00000100:00100000:2.0:1789762790.303530:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789762790.303538:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254888192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762790.303545:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762790.303557:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59233 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.303573:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 19 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.303583:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 19 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.303590:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461600, rc 0) 00000100:00100000:2.0:1789762790.303631:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254888192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.303639:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789762790.303726:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254888192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762790.303746:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762790.303788:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762790.303849:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254888320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.303888:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.303946:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.303970:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888320 00000100:00100000:2.0:1789762790.303973:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888320 00000100:00100000:2.0:1789762790.304004:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789762790.304013:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254888320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.304088:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254888320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.304093:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789762790.304128:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254888320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.304150:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254888448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.304187:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.304204:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.304218:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888448 00000100:00100000:2.0:1789762790.304223:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888448 00000100:00100000:2.0:1789762790.304263:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789762790.304276:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254888448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.304354:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254888448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.304361:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789762790.304405:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254888448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762790.304609:0:8870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8870:1876702254888576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.304656:0:8870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.304682:0:8870:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789762790.304708:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888576 00000100:00100000:0.0:1789762790.304729:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888576 00000100:00100000:0.0:1789762790.304818:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789762790.304835:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:8870:x1876702254888576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762790.304960:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:8870:x1876702254888576:12345-0@lo:502:llog_process_th.0 Request processed in 131us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.304968:0:8870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8870:1876702254888576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789762790.304975:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000020:01000000:2.0:1789762790.305004:0:8870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789762790.305009:0:8870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762790.305011:0:8870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789762790.305015:0:8870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b33c8a8a800 00000020:00000080:2.0:1789762790.305018:0:8870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789762790.305088:0:8870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8870:1876702254888704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.305134:0:8870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762790.305160:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888704 00000100:00100000:2.0:1789762790.305164:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888704 00000100:00100000:2.0:1789762790.305195:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789762790.305207:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:8870:x1876702254888704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789762790.305287:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:8870:x1876702254888704:12345-0@lo:502:llog_process_th.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762790.305292:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789762790.305341:0:8870:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e2db7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789762790.305352:0:8870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:8870:1876702254888704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789762790.305370:0:8870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789762790.305374:0:8870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789762790.305375:0:8870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789762790.305378:0:8870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789762790.305446:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789762790.305474:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789762790.305483:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762790.305493:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762791.291853:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762791.619713:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762791.619778:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475008 00000100:00100000:2.0:1789762791.619788:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475008 00000100:00100000:2.0:1789762791.619835:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:2.0:1789762791.619844:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+9:5433:x1876702246475008:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762791.619866:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762791.619881:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b878944354 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.619904:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 10 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.619913:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 10 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762791.619932:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461a00, rc 0) 00000100:00100000:2.0:1789762791.619988:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246475008:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 143us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762791.619997:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:2.0:1789762791.620932:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762791.620968:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475136 00000100:00100000:0.0:1789762791.620973:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475136 00000100:00100000:0.0:1789762791.621007:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:0.0:1789762791.621017:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246475136:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762791.621131:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246475136:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 114us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762791.621157:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:0.0:1789762791.621764:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762791.621802:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475264 00000100:00100000:2.0:1789762791.621806:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475264 00000100:00100000:2.0:1789762791.621836:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:2.0:1789762791.621846:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246475264:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762791.621928:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:5433:x1876702246475264:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762791.621937:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:2.0:1789762791.622811:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762791.622837:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475392 00000100:00100000:3.0:1789762791.622843:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475392 00000100:00100000:3.0:1789762791.622919:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:3.0:1789762791.622927:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+10:6194:x1876702246475392:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789762791.623001:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+10:6194:x1876702246475392:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762791.623009:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:3.0:1789762791.623732:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762791.623777:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475520 00000100:00100000:2.0:1789762791.623783:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475520 00000100:00100000:2.0:1789762791.623820:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:2.0:1789762791.623829:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:6194:x1876702246475520:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789762791.623913:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:6194:x1876702246475520:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762791.623922:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 183 00000001:02000400:3.0:1789762791.943128:0:9151:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789762792.250881:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254888832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762792.250900:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254889216:0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.250927:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254888960:0@lo:400:kworker.0 00000100:00100000:2.0:1789762792.250952:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762792.250984:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254889088:0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.250993:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762792.251009:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762792.251023:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254889472:0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.251025:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254889344:0@lo:400:kworker.0 00000100:00100000:0.0:1789762792.251047:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762792.251077:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762792.251078:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762792.251079:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889216 00000100:00100000:0.0:1789762792.251080:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254889600:0@lo:400:kworker.0 00000100:00100000:3.0:1789762792.251089:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889216 00000100:00100000:0.0:1789762792.251118:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762792.251142:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888832 00000100:00100000:1.0:1789762792.251147:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888832 00000100:00100000:2.0:1789762792.251153:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889088 00000100:00100000:3.0:1789762792.251153:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889472 00000100:00100000:2.0:1789762792.251160:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889088 00000100:00100000:3.0:1789762792.251161:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889472 00000100:00100000:0.0:1789762792.251180:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789762792.251194:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254889216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.251200:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789762792.251205:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789762792.251211:0:5926:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789762792.251217:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254888832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762792.251218:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254889088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762792.251222:0:5926:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1789762792.251245:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762792.251247:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254889216:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00002000:00000024:1.0:1789762792.251249:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1789762792.251257:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762792.251265:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789762792.251280:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789762792.251281:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254889088:12345-0@lo:400:kworker.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762792.251288:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789762792.251294:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789762792.251295:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254889472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.251310:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254888832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762792.251321:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789762792.251334:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254889088:0@lo:400:kworker.0 00000100:00100000:3.0:1789762792.251344:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254889472:12345-0@lo:400:kworker.0 Request processed in 54us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762792.251352:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762792.251353:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254888960 00000100:00100000:1.0:1789762792.251358:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254888960 00000100:00100000:0.0:1789762792.251381:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889344 00000100:00100000:0.0:1789762792.251386:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889344 00000100:00100000:3.0:1789762792.251393:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254889216:0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.251398:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789762792.251409:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254888960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762792.251414:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762792.251431:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889600 00000100:00100000:0.0:1789762792.251435:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889600 00000100:00100000:3.0:1789762792.251436:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789762792.251446:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254889344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.251464:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254888960:12345-0@lo:400:kworker.0 Request processed in 56us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762792.251471:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789762792.251478:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789762792.251484:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254889600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762792.251489:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254889344:12345-0@lo:400:kworker.0 Request processed in 42us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762792.251495:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789762792.251535:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254889600:12345-0@lo:400:kworker.0 Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762792.251536:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254888960:0@lo:400:kworker.0 00000100:00100000:0.0:1789762792.251548:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789762792.251558:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f47faa00 x1876702254889344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762792.251568:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254889344:0@lo:400:kworker.0 00010000:00080000:0.0:1789762792.251583:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f47f8700 x1876702254889600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762792.251592:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254889600:0@lo:400:kworker.0 00000100:00100000:1.0:1789762792.251599:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254889472:0@lo:400:kworker.0 00010000:00080000:1.0:1789762792.251618:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f74aa680 x1876702254888832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762792.251637:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254888832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789762792.314835:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789762792.764870:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:02000400:0.0:1789762793.286599:0:9395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing yml_node 00010000:00010000:2.0:1789762793.338870:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762794.298946:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762794.298967:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254889728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762794.299035:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762794.299087:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889728 00000100:00100000:2.0:1789762794.299098:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889728 00000100:00080000:3.0:1789762794.299136:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762794.299171:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789762794.299184:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254889728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789762794.299215:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762794.299260:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254889728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762794.299267:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789762794.299297:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f463ca80 x1876702254889728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762794.299314:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254889728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762794.362920:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762794.371895:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762794.371939:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762794.371952:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475776 00000100:00100000:0.0:1789762794.371973:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475776 00000100:00100000:2.0:1789762794.371986:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762794.371991:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475648 00000100:00100000:3.0:1789762794.371998:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475648 00000100:00100000:2.0:1789762794.372038:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762794.372078:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476032 00000100:00100000:0.0:1789762794.372079:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:3.0:1789762794.372079:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:2.0:1789762794.372085:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476032 00000100:00100000:0.0:1789762794.372100:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246475776:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762794.372101:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2356:x1876702246475648:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762794.372123:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246475904 00000100:00100000:2.0:1789762794.372127:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246475904 00000100:00100000:2.0:1789762794.372167:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:2.0:1789762794.372176:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246476032:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762794.372199:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246475776:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 105us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762794.372202:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2356:x1876702246475648:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762794.372217:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246476032:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 41us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762794.372227:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:3.0:1789762794.372227:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:2.0:1789762794.372250:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:2.0:1789762794.372277:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:2.0:1789762794.372286:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246475904:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:0.0:1789762794.372296:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762794.372319:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762794.372323:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762794.372335:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246475904:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 47us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762794.372345:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000001:02000400:1.0:1789762794.627894:0:9578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.106 00010000:00010000:2.0:1789762795.386874:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789762795.390608:0:9675:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.106 00000001:02000400:1.0:1789762796.351338:0:9772:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.106 00010000:00010000:2.0:1789762796.410871:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762796.959262:0:9820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanityn ============----- Fri Sep 18 16:19:56 EDT 2026 00000100:00100000:1.0:1789762797.370887:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254889856:0@lo:400:kworker.0 00000100:00100000:3.0:1789762797.370897:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254890240:0@lo:400:kworker.0 00000100:00100000:3.0:1789762797.370978:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762797.370981:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762797.371042:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254890112:0@lo:400:kworker.0 00000100:00100000:1.0:1789762797.371044:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254890368:0@lo:400:kworker.0 00000100:00100000:3.0:1789762797.371073:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254890240 00000100:00100000:3.0:1789762797.371080:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254890240 00000100:00100000:0.0:1789762797.371095:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762797.371096:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762797.371139:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254890624:0@lo:400:kworker.0 00000100:00100000:1.0:1789762797.371139:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889856 00000100:00100000:3.0:1789762797.371144:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254890112 00000100:00100000:1.0:1789762797.371145:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889856 00000100:00100000:3.0:1789762797.371150:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254890112 00000100:00100000:2.0:1789762797.371154:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762797.371167:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762797.371179:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762797.371188:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789762797.371195:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789762797.371201:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254889856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762797.371207:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789762797.371208:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254890112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762797.371217:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254889984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762797.371233:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254890240:12345-0@lo:400:kworker.0 Request processed in 70us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762797.371241:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789762797.371264:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254890112:12345-0@lo:400:kworker.0 Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762797.371266:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254889856:12345-0@lo:400:kworker.0 Request processed in 70us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762797.371278:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762797.371278:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789762797.371278:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789762797.371307:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762797.371316:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254890496:0@lo:400:kworker.0 00000100:00100000:1.0:1789762797.371322:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254890368 00000100:00100000:1.0:1789762797.371327:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254890368 00000100:00100000:3.0:1789762797.371327:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254890624 00000100:00100000:3.0:1789762797.371332:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254890624 00000100:00100000:0.0:1789762797.371352:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762797.371384:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789762797.371390:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254890112:0@lo:400:kworker.0 00000100:00100000:3.0:1789762797.371398:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789762797.371399:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254890368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762797.371412:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254890624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762797.371419:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254890496 00000100:00100000:0.0:1789762797.371423:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254890496 00000100:00100000:0.0:1789762797.371459:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789762797.371469:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254890368:12345-0@lo:400:kworker.0 Request processed in 76us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762797.371476:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254890496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762797.371479:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254890624:12345-0@lo:400:kworker.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762797.371483:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789762797.371492:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789762797.371520:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254889984 00000100:00100000:1.0:1789762797.371525:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254889984 00000100:00100000:0.0:1789762797.371529:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254890496:12345-0@lo:400:kworker.0 Request processed in 56us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762797.371537:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789762797.371537:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254890240:0@lo:400:kworker.0 00000100:00100000:1.0:1789762797.371562:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789762797.371572:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254889984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762797.371574:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254890496:0@lo:400:kworker.0 00000100:00080000:0.0:1789762797.371586:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762797.371591:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789762797.371593:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f463e680 x1876702254890624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789762797.371595:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789762797.371596:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762797.371607:0:3420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00010000:00080000:0.0:1789762797.371617:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f463c380 x1876702254890368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762797.371619:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254890624:0@lo:400:kworker.0 00000100:00100000:0.0:1789762797.371635:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254890368:0@lo:400:kworker.0 00000100:00100000:1.0:1789762797.371641:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254889984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762797.371647:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789762797.371652:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254889856:0@lo:400:kworker.0 00010000:00080000:3.0:1789762797.371671:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f47faa00 x1876702254889984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762797.371701:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254889984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789762797.434846:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762798.458832:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762799.419855:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254890752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762799.419920:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762799.419957:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254890752 00000100:00100000:2.0:1789762799.419965:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254890752 00000100:00080000:1.0:1789762799.420014:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762799.420023:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789762799.420030:0:6913:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789762799.420034:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254890752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762799.420039:0:6913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1789762799.420069:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762799.420127:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254890752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762799.420133:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789762799.420145:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f463ed80 x1876702254890752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789762799.420162:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254890752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762799.482870:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762799.491693:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762799.491736:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762799.491737:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476160 00000100:00100000:0.0:1789762799.491776:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476160 00000100:00100000:2.0:1789762799.491786:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762799.491796:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476288 00000100:00100000:1.0:1789762799.491802:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476288 00000100:00100000:2.0:1789762799.491817:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762799.491833:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:0.0:1789762799.491845:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2353:x1876702246476160:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762799.491848:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476416 00000100:00100000:2.0:1789762799.491853:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476416 00000100:00100000:1.0:1789762799.491857:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:1.0:1789762799.491870:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246476288:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762799.491889:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476544 00000100:00100000:2.0:1789762799.491893:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476544 00000100:00100000:0.0:1789762799.491916:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+10:2353:x1876702246476160:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762799.491917:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246476288:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762799.491920:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:2.0:1789762799.491934:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246476416:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762799.491941:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:1.0:1789762799.491941:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:2.0:1789762799.491975:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246476416:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762799.491984:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00080000:0.0:1789762799.491995:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762799.491999:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762799.492002:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762799.492009:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:2.0:1789762799.492020:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246476544:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762799.492046:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246476544:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762799.492051:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00010000:00010000:0.0:1789762800.506914:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762801.530901:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762801.914376:0:10548:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 40a 00000001:02000400:1.0:1789762802.404368:0:10596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 33a 00000100:00100000:2.0:1789762802.490908:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254891008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762802.490910:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254890880:0@lo:400:kworker.0 00000100:00100000:0.0:1789762802.490928:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254891136:0@lo:400:kworker.0 00000100:00100000:3.0:1789762802.490971:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254891264:0@lo:400:kworker.0 00000100:00100000:2.0:1789762802.490994:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762802.490996:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762802.490996:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762802.491026:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762802.491078:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254891520:0@lo:400:kworker.0 00000100:00100000:0.0:1789762802.491081:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254891648:0@lo:400:kworker.0 00000100:00100000:2.0:1789762802.491081:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254891392:0@lo:400:kworker.0 00000100:00100000:3.0:1789762802.491088:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891136 00000100:00100000:3.0:1789762802.491099:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891136 00000100:00100000:1.0:1789762802.491116:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762802.491121:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762802.491143:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762802.491156:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891264 00000100:00100000:3.0:1789762802.491160:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891264 00000100:00100000:2.0:1789762802.491166:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891008 00000100:00100000:2.0:1789762802.491171:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891008 00000100:00100000:1.0:1789762802.491192:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254890880 00000100:00100000:1.0:1789762802.491198:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254890880 00000100:00100000:3.0:1789762802.491201:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891520 00000100:00100000:3.0:1789762802.491206:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891520 00000100:00100000:2.0:1789762802.491219:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789762802.491221:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789762802.491233:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254891008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762802.491235:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254891136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762802.491242:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789762802.491245:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789762802.491259:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254891264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762802.491260:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254890880:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789762802.491263:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762802.491286:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254891136:12345-0@lo:400:kworker.0 Request processed in 57us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762802.491293:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789762802.491316:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789762802.491331:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254891008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762802.491332:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254891520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762802.491333:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254890880:12345-0@lo:400:kworker.0 Request processed in 77us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762802.491340:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254891264:12345-0@lo:400:kworker.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762802.491352:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789762802.491353:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789762802.491359:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789762802.491379:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254891520:12345-0@lo:400:kworker.0 Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762802.491386:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789762802.491392:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762802.491396:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891392 00000100:00080000:3.0:1789762802.491398:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762802.491403:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891392 00000100:00100000:0.0:1789762802.491421:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891648 00000100:00100000:0.0:1789762802.491426:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891648 00000100:00100000:1.0:1789762802.491436:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254891520:0@lo:400:kworker.0 00000100:00100000:3.0:1789762802.491437:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254891264:0@lo:400:kworker.0 00000100:00100000:2.0:1789762802.491451:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789762802.491461:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254890880:0@lo:400:kworker.0 00000100:00100000:2.0:1789762802.491466:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254891392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762802.491467:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789762802.491480:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762802.491484:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254891648:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789762802.491506:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f47fad80 x1876702254891008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762802.491513:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254891392:12345-0@lo:400:kworker.0 Request processed in 53us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762802.491531:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254891136:0@lo:400:kworker.0 00000100:00100000:2.0:1789762802.491531:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789762802.491536:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254891648:12345-0@lo:400:kworker.0 Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762802.491541:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254891008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762802.491547:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789762802.491567:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33fee3fb80 x1876702254891648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789762802.491573:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f453d180 x1876702254891392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762802.491588:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254891648:0@lo:400:kworker.0 00000100:00100000:3.0:1789762802.491590:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254891392:0@lo:400:kworker.0 00010000:00010000:3.0:1789762802.554866:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762802.896709:0:10644:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: start setup 16:20:02 (1789762802) === 00000100:00100000:1.0:1789762803.065615:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.065696:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476672 00000100:00100000:2.0:1789762803.065706:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476672 00000100:00100000:2.0:1789762803.065775:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:2.0:1789762803.065786:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+10:8279:x1876702246476672:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789762803.065801:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762803.065815:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f7460800/0x5915dfb1c1b59248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b87894435b expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762803.065841:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f7460800/0x5915dfb1c1b59248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894435b expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762803.065869:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f7460800/0x5915dfb1c1b59248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894435b expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762803.065880:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460800, rc 0) 00000100:00100000:2.0:1789762803.065929:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8279:x1876702246476672:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.065935:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:3.0:1789762803.066820:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.066880:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476800 00000100:00100000:1.0:1789762803.066886:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476800 00000100:00100000:1.0:1789762803.066924:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:1.0:1789762803.066935:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8279:x1876702246476800:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789762803.067074:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8279:x1876702246476800:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 140us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.067084:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:0.0:1789762803.067776:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.067828:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246476928 00000100:00100000:2.0:1789762803.067835:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246476928 00000100:00100000:2.0:1789762803.067871:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1789762803.067880:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8279:x1876702246476928:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789762803.067956:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8279:x1876702246476928:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.067962:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1789762803.068943:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.068986:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477056 00000100:00100000:1.0:1789762803.068992:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477056 00000100:00100000:1.0:1789762803.069025:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:1.0:1789762803.069035:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8282:x1876702246477056:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789762803.069113:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8282:x1876702246477056:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 80us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.069119:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:3.0:1789762803.075069:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.075113:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477184 00000100:00100000:2.0:1789762803.075120:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477184 00000100:00100000:2.0:1789762803.075155:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:2.0:1789762803.075165:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8282:x1876702246477184:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789762803.075240:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8282:x1876702246477184:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 77us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.075247:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:0.0:1789762803.076112:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.076156:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477312 00000100:00100000:1.0:1789762803.076161:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477312 00000100:00100000:1.0:1789762803.076188:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:1.0:1789762803.076194:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+11:8279:x1876702246477312:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789762803.076201:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762803.076209:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b5924f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b878944385 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762803.076224:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b5924f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944385 expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762803.076233:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c1663800/0x5915dfb1c1b5924f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944385 expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762803.076239:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663800, rc 0) 00000100:00100000:1.0:1789762803.076264:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+12:8279:x1876702246477312:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 71us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.076269:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:1.0:1789762803.077390:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.077462:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477440 00000100:00100000:2.0:1789762803.077468:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477440 00000100:00100000:2.0:1789762803.077495:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:2.0:1789762803.077508:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+12:8279:x1876702246477440:12345-192.168.203.36@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789762803.077522:0:5917:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789762803.077534:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789762803.077537:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789762803.077540:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789762803.077541:0:5917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789762803.078159:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+12:8279:x1876702246477440:12345-192.168.203.36@tcp:256:mount.lustre.0 Request processed in 650us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.078166:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:0.0:1789762803.079826:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.079876:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477568 00000100:00100000:1.0:1789762803.079882:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477568 00000100:00100000:1.0:1789762803.079915:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:1.0:1789762803.079924:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+12:8279:x1876702246477568:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789762803.079932:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762803.079948:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b87894438c expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762803.079966:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 13 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762803.079977:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 13 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762803.079985:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663e00, rc 0) 00000100:00100000:1.0:1789762803.080020:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8279:x1876702246477568:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 97us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.080028:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:1.0:1789762803.083403:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.083474:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477696 00000100:00100000:2.0:1789762803.083480:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477696 00000100:00100000:2.0:1789762803.083511:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:2.0:1789762803.083517:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8279:x1876702246477696:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789762803.083599:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8279:x1876702246477696:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.083604:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:3.0:1789762803.084229:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.084287:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477824 00000100:00100000:1.0:1789762803.084295:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477824 00000100:00100000:1.0:1789762803.084333:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:1.0:1789762803.084344:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8279:x1876702246477824:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789762803.084446:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8279:x1876702246477824:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.084458:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:0.0:1789762803.085675:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.085720:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246477952 00000100:00100000:2.0:1789762803.085725:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246477952 00000100:00100000:2.0:1789762803.085777:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:2.0:1789762803.085784:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8286:x1876702246477952:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789762803.085846:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8286:x1876702246477952:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762803.085852:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:2.0:1789762803.086509:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.086557:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478080 00000100:00100000:1.0:1789762803.086562:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478080 00000100:00100000:1.0:1789762803.086587:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:1.0:1789762803.086594:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8286:x1876702246478080:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789762803.086666:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:8286:x1876702246478080:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.086679:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:3.0:1789762803.088026:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762803.088093:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762803.088115:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478208 00000100:00100000:0.0:1789762803.088122:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478208 00000100:00100000:3.0:1789762803.088122:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.088140:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478464 00000100:00100000:1.0:1789762803.088146:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478464 00000100:00100000:0.0:1789762803.088165:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:3.0:1789762803.088170:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.088175:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478720 00000100:00100000:0.0:1789762803.088177:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1876702246478208:12345-192.168.203.36@tcp:38:mount.lustre.0 00000100:00100000:2.0:1789762803.088181:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478720 00000100:00100000:1.0:1789762803.088195:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00080000:3.0:1789762803.088197:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762803.088203:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789762803.088209:0:7598:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 16ee4165-0fa4-42d2-b611-78faaebc19a7@192.168.203.36@tcp t0 exp 0000000000000000 cur 105 last 0 00000100:00100000:1.0:1789762803.088209:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246478464:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762803.088216:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478592 00000100:00100000:3.0:1789762803.088222:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478592 00000100:00100000:2.0:1789762803.088232:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:2.0:1789762803.088243:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246478720:12345-192.168.203.36@tcp:400:kworker.0 00000020:00000080:0.0:1789762803.088259:0:7598:0:(genops.c:1385:class_connect()) connect: client 16ee4165-0fa4-42d2-b611-78faaebc19a7, cookie 0x5915dfb1c1b5925d 00000100:00100000:1.0:1789762803.088261:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246478464:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762803.088268:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:1.0:1789762803.088271:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1789762803.088281:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246478720:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 39us (160us total) trans 0 rc 0/0 00000004:00100000:0.0:1789762803.088284:0:7598:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789762803.088285:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246478592:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762803.088294:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1789762803.088327:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246478592:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762803.088335:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00080000:3.0:1789762803.088359:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762803.088393:0:7598:0:(import.c:65:import_set_state_nolock()) ffff9b33fee64000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789762803.088430:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2352:x1876702246478208:12345-192.168.203.36@tcp:38:mount.lustre.0 Request processed in 256us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762803.088436:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:3.0:1789762803.089121:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762803.089152:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.089172:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478848 00000100:00100000:1.0:1789762803.089176:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478848 00000100:00080000:3.0:1789762803.089209:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762803.089212:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478336 00000100:00100000:0.0:1789762803.089218:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478336 00000100:00100000:1.0:1789762803.089218:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:1.0:1789762803.089231:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+7:8279:x1876702246478848:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789762803.089249:0:5924:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1789762803.089261:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:0.0:1789762803.089272:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+7:0:x1876702246478336:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789762803.089291:0:5925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1789762803.089300:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+7:8279:x1876702246478848:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762803.089306:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:0.0:1789762803.089333:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:0:x1876702246478336:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762803.089340:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1789762803.089915:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762803.089952:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246478976 00000100:00100000:0.0:1789762803.089956:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246478976 00000100:00100000:0.0:1789762803.089980:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:0.0:1789762803.089986:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:8279:x1876702246478976:12345-192.168.203.36@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789762803.090024:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:8279:x1876702246478976:12345-192.168.203.36@tcp:40:mount.lustre.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762803.090029:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:2.0:1789762803.090631:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762803.090671:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246479104 00000100:00100000:1.0:1789762803.090676:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246479104 00000100:00100000:1.0:1789762803.090698:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1789762803.090704:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876702246479104:12345-192.168.203.36@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789762803.090717:0:6911:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 16ee4165-0fa4-42d2-b611-78faaebc19a7@192.168.203.36@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:1.0:1789762803.090736:0:6911:0:(genops.c:1385:class_connect()) connect: client 16ee4165-0fa4-42d2-b611-78faaebc19a7, cookie 0x5915dfb1c1b59264 00002000:00100000:1.0:1789762803.090742:0:6911:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 16ee4165-0fa4-42d2-b611-78faaebc19a7/ffff9b33f750f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789762803.090774:0:6911:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789762803.090788:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762803.090822:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246479232 00000100:00100000:2.0:1789762803.090827:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246479232 00002000:00080000:1.0:1789762803.090832:0:6911:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789762803.090854:0:6911:0:(import.c:65:import_set_state_nolock()) ffff9b33f7508800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762803.090855:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:2.0:1789762803.090865:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876702246479232:12345-192.168.203.36@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789762803.090878:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00080000:2.0:1789762803.090883:0:6909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 16ee4165-0fa4-42d2-b611-78faaebc19a7@192.168.203.36@tcp t0 exp 0000000000000000 cur 105 last 0 00000100:00100000:1.0:1789762803.090895:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2352:x1876702246479104:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 188us (262us total) trans 0 rc 0/0 00000020:00000080:2.0:1789762803.090902:0:6909:0:(genops.c:1385:class_connect()) connect: client 16ee4165-0fa4-42d2-b611-78faaebc19a7, cookie 0x5915dfb1c1b5926b 00000100:00100000:1.0:1789762803.090903:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:0.0:1789762803.090907:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246479360 00002000:00100000:2.0:1789762803.090910:0:6909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 16ee4165-0fa4-42d2-b611-78faaebc19a7/ffff9b33f726b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789762803.090913:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246479360 00002000:00100000:2.0:1789762803.090918:0:6909:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789762803.090968:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00002000:00080000:2.0:1789762803.090976:0:6909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1789762803.090981:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:8279:x1876702246479360:12345-192.168.203.36@tcp:33:mount.lustre.0 00000100:00080000:2.0:1789762803.090997:0:6909:0:(import.c:65:import_set_state_nolock()) ffff9b33f726a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789762803.091032:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2352:x1876702246479232:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 168us (247us total) trans 0 rc 0/0 00000004:00200000:0.0:1789762803.091033:0:5927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789762803.091044:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:0.0:1789762803.091076:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:8279:x1876702246479360:12345-192.168.203.36@tcp:33:mount.lustre.0 Request processed in 99us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762803.091084:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00010000:00010000:2.0:1789762803.579880:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762804.538877:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789762804.538910:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254891776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762804.538968:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762804.539010:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891776 00000100:00100000:1.0:1789762804.539019:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891776 00000100:00080000:3.0:1789762804.539064:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762804.539083:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789762804.539096:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254891776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762804.539119:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762804.539170:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254891776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762804.539179:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789762804.539204:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33fee3ce00 x1876702254891776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762804.539227:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254891776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789762804.602893:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789762804.760905:0:10836:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789762805.626829:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762806.650979:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789762806.669559:0:11098:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789762806.669719:0:11098:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1789762807.278567:0:11195:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789762807.278731:0:11195:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789762807.610867:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254891904:0@lo:400:kworker.0 00000100:00100000:1.0:1789762807.610868:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254892032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762807.610907:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254892288:0@lo:400:kworker.0 00000100:00100000:2.0:1789762807.610947:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762807.610954:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762807.610959:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762807.611029:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254892544:0@lo:400:kworker.0 00000100:00100000:2.0:1789762807.611030:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254892416:0@lo:400:kworker.0 00000100:00100000:1.0:1789762807.611076:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762807.611083:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762807.611115:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789762807.611126:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254892160:0@lo:400:kworker.0 00000100:00100000:2.0:1789762807.611143:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254891904 00000100:00100000:2.0:1789762807.611151:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254891904 00000100:00100000:1.0:1789762807.611156:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762807.611189:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254892672:0@lo:400:kworker.0 00000100:00100000:2.0:1789762807.611201:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789762807.611208:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254892288 00000100:00100000:2.0:1789762807.611213:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254891904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762807.611214:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254892288 00000100:00100000:1.0:1789762807.611223:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762807.611264:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254892032 00000100:00100000:0.0:1789762807.611268:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254892544 00000100:00100000:1.0:1789762807.611269:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254892032 00000100:00100000:0.0:1789762807.611274:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254892544 00000100:00100000:2.0:1789762807.611280:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254891904:12345-0@lo:400:kworker.0 Request processed in 67us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762807.611292:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789762807.611306:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254892160 00000100:00100000:0.0:1789762807.611310:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254892160 00000100:00100000:1.0:1789762807.611316:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789762807.611327:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254892032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762807.611334:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789762807.611347:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789762807.611348:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254892288:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789762807.611360:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762807.611362:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254892544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762807.611396:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254892288:12345-0@lo:400:kworker.0 Request processed in 52us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762807.611403:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789762807.611418:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254892032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762807.611428:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789762807.611429:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254892544:12345-0@lo:400:kworker.0 Request processed in 68us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762807.611430:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789762807.611441:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789762807.611443:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254892160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762807.611471:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254892416 00000100:00100000:2.0:1789762807.611476:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254892416 00000100:00100000:1.0:1789762807.611481:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254892544:0@lo:400:kworker.0 00000100:00100000:0.0:1789762807.611483:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254892160:12345-0@lo:400:kworker.0 Request processed in 44us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762807.611491:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789762807.611503:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f47f9180 x1876702254892032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762807.611508:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254892672 00000100:00100000:2.0:1789762807.611512:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254892672 00000100:00100000:1.0:1789762807.611519:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254892032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762807.611534:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762807.611544:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789762807.611549:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254892160:0@lo:400:kworker.0 00000100:00100000:0.0:1789762807.611551:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254892416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762807.611556:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254892672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762807.611725:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254892416:12345-0@lo:400:kworker.0 Request processed in 181us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762807.611731:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789762807.611739:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254892672:12345-0@lo:400:kworker.0 Request processed in 186us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762807.611748:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789762807.611779:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762807.611785:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762807.611790:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762807.611825:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254892288:0@lo:400:kworker.0 00010000:00080000:2.0:1789762807.611854:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f74a9500 x1876702254892416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762807.611868:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254892416:0@lo:400:kworker.0 00010000:00080000:0.0:1789762807.611880:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f74aa680 x1876702254892672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789762807.611890:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254892672:0@lo:400:kworker.0 00000100:00100000:2.0:1789762807.611895:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254891904:0@lo:400:kworker.0 00010000:00010000:0.0:1789762807.674864:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789762807.900414:0:11292:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762807.900553:0:11292:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789762808.195829:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762808.195870:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246479488 00000100:00100000:0.0:1789762808.195879:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246479488 00000100:00100000:0.0:1789762808.195924:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:0.0:1789762808.195934:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246479488:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762808.196001:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246479488:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762808.196011:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:0.0:1789762808.196119:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762808.196153:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246479616 00000100:00100000:2.0:1789762808.196158:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246479616 00000100:00080000:0.0:1789762808.196204:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762808.196208:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:2.0:1789762808.196218:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246479616:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762808.196270:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246479616:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762808.196279:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:3.0:1789762808.198460:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762808.198522:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762808.198525:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246479744 00000100:00100000:0.0:1789762808.198531:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246479744 00000100:00100000:3.0:1789762808.198551:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762808.198555:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480000 00000100:00100000:2.0:1789762808.198562:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480000 00000100:00100000:0.0:1789762808.198589:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246479872 00000100:00100000:0.0:1789762808.198595:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246479872 00000100:00100000:3.0:1789762808.198598:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762808.198620:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:0.0:1789762808.198631:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480256 00000100:00100000:2.0:1789762808.198632:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2354:x1876702246480000:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762808.198638:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762808.198643:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480256 00000100:00100000:3.0:1789762808.198661:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480128 00000100:00100000:3.0:1789762808.198667:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480128 00000100:00100000:0.0:1789762808.198674:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:2.0:1789762808.198683:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2354:x1876702246480000:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762808.198689:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2354:x1876702246480256:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762808.198695:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:3.0:1789762808.198702:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1789762808.198715:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2353:x1876702246480128:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762808.198725:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2354:x1876702246480256:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762808.198733:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:3.0:1789762808.198784:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+6:2353:x1876702246480128:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762808.198908:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1789762808.198916:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1789762808.198921:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2352:x1876702246479744:12345-192.168.203.36@tcp:9:kworker.0 00000100:00100000:2.0:1789762808.198928:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:2.0:1789762808.198938:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2352:x1876702246479872:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:0.0:1789762808.198940:0:6911:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5915dfb1c1b5910d 00000020:00000080:2.0:1789762808.198953:0:6912:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5915dfb1c1b59114 00000100:00080000:3.0:1789762808.198954:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762808.198955:0:6911:0:(import.c:65:import_set_state_nolock()) ffff9b33fe866800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789762808.198959:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789762808.198964:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762808.198974:0:6912:0:(import.c:65:import_set_state_nolock()) ffff9b33fed9b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789762808.198998:0:6911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:2.0:1789762808.199019:0:6912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1789762808.199073:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762808.199154:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+2:2352:x1876702246479872:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 211us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762808.199155:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+2:2352:x1876702246479744:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 231us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762808.199166:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:0.0:1789762808.199174:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00010000:00010000:3.0:1789762808.199431:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789762808.200235:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:3.0:1789762808.200244:0:6905:0:(genops.c:885:class_export_put()) final put ffff9b33fe867800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000001:00100000:0.0:1789762808.200262:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000001:00100000:3.0:1789762808.200265:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16ee4165-0fa4-42d2-b611-78faaebc19a7 00000020:00000080:0.0:1789762808.200268:0:7983:0:(genops.c:885:class_export_put()) final put ffff9b33fed99800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:2.0:1789762808.200280:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b33fe867800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 for lustre-OST0000 00000001:00100000:0.0:1789762808.200281:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16ee4165-0fa4-42d2-b611-78faaebc19a7 00000020:00000080:2.0:1789762808.200319:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b33fed99800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 for lustre-OST0001 00000020:00000080:2.0:1789762808.200340:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b33fe866800 for lustre-OST0000 00000020:00000080:2.0:1789762808.200344:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b33fed9b800 for lustre-OST0001 00000020:00000004:1.0:1789762808.515431:0:11389:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762808.515681:0:11389:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:3.0:1789762808.635556:0:5903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16ee4165-0fa4-42d2-b611-78faaebc19a7 00010000:00010000:3.0:1789762808.698905:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789762809.629338:0:11533:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789762809.658874:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254892800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762809.658942:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762809.658977:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254892800 00000100:00100000:1.0:1789762809.658986:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254892800 00000100:00080000:3.0:1789762809.659034:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762809.659064:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789762809.659079:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254892800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762809.659104:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762809.659149:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254892800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762809.659155:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789762809.659187:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3400418a80 x1876702254892800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762809.659205:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254892800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789762809.722898:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789762810.689328:0:11680:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb13bbcd0 20000000:00000080:0.0:1789762810.689341:0:11680:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b33f753bc00 uarg=0000000000000000 20000000:01000000:0.0:1789762810.689372:0:11680:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789762810.689376:0:11680:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789762810.689380:0:11680:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789762810.689691:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789762810.689778:0:11680:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789762810.692904:0:11680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789762810.692921:0:11680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.692936:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 18 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.692941:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.692946:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.692952:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 12 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.692957:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.692962:0:11680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.692992:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 12 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693002:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 12 pid: 5920 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.693013:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254892928:192.168.203.36@tcp:104: 00010000:00010000:0.0:1789762810.693117:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 12 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693134:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 12 pid: 5919 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.693142:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893056:192.168.203.36@tcp:104: 00010000:00010000:0.0:1789762810.693172:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 18 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693178:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 18 pid: 5919 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.693185:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893184:0@lo:104: 00000100:00100000:0.0:1789762810.693216:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789762810.693248:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693255:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 18 pid: 5917 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762810.693258:0:7991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254893184 00000100:00100000:0.0:1789762810.693262:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893312:0@lo:104: 00000100:00100000:3.0:1789762810.693266:0:7991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254893184 00000100:00100000:0.0:1789762810.693288:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789762810.693320:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 18 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693330:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 18 pid: 5920 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.693340:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893440:0@lo:104: 00000100:00100000:1.0:1789762810.693341:0:6925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254893312 00000100:00100000:1.0:1789762810.693347:0:6925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254893312 00000100:00100000:0.0:1789762810.693368:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762810.693389:0:6925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254893440 00000100:00100000:1.0:1789762810.693393:0:6925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254893440 00000100:00100000:0.0:1789762810.693403:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e0f58900 going to sleep for 11 seconds 00000100:00100000:1.0:1789762810.693415:0:6925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789762810.693426:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789762810.693428:0:6925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:11680:x1876702254893312:12345-0@lo:104: 00000100:00100000:2.0:1789762810.693442:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:11680:x1876702254893184:12345-0@lo:104: 00000100:00100000:3.0:1789762810.693444:0:7991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789762810.693449:0:6925:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.693455:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762810.693461:0:7991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:11680:x1876702254893440:12345-0@lo:104: 00010000:00010000:3.0:1789762810.693474:0:7991:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.693525:0:6925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789762810.693534:0:6925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:11680:x1876702254893312:12345-0@lo:104: Request processed in 110us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762810.693534:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789762810.693541:0:7991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789762810.693545:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:11680:x1876702254893184:12345-0@lo:104: Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762810.693552:0:6925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789762810.693553:0:7991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+5:11680:x1876702254893440:12345-0@lo:104: Request processed in 95us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762810.693554:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893184:0@lo:104: 00000100:00100000:2.0:1789762810.693579:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789762810.693587:0:7991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789762810.693592:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893312:0@lo:104: 00000100:00100000:0.0:1789762810.693608:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893440:0@lo:104: 00010000:00010000:1.0:1789762810.693617:0:8854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789762810.693619:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789762810.693624:0:8854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.693625:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693636:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762810.693643:0:8854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:0.0:1789762810.693644:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789762810.693649:0:8854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693667:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663000 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:2.0:1789762810.693668:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461200 already unused, calling callback (ffffffffc1490c20) 00010000:00010000:1.0:1789762810.693670:0:8854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789762810.693671:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762810.693672:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.693691:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693694:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789762810.693694:0:8854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789762810.693699:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789762810.693710:0:8854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789762810.693711:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1789762810.693712:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762810.693721:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789762810.693748:0:8854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.693780:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.693784:0:8854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789762810.693792:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.693793:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789762810.693802:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789762810.693810:0:8854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.693817:0:8854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f7460200/0x5915dfb1c1b59225 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5922c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693821:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.693822:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.693841:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33c1663000/0x5915dfb1c1b59217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5921e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.693844:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9b33f7461200/0x5915dfb1c1b59233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5915dfb1c1b5923a expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.693846:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762810.693850:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762810.693854:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762810.693859:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762810.693866:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762810.693868:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762810.693869:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762810.693869:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254893568:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789762810.693873:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762810.693878:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762810.693894:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254893696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789762810.693906:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f764bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254893824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789762810.693907:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762810.693950:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762810.693962:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254893568 00000100:00100000:0.0:1789762810.693968:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254893568 00000100:00100000:1.0:1789762810.693976:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254893696 00000100:00100000:1.0:1789762810.693980:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254893696 00010000:00010000:0.0:1789762810.693992:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 20 pid: 5917 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.693995:0:7992:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 20 pid: 5919 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762810.694005:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762810.694028:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254893824 00000100:00100000:0.0:1789762810.694033:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254893824 00000100:00100000:1.0:1789762810.694047:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789762810.694050:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 21 pid: 5920 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762810.694057:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789762810.694058:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+21:3418:x1876702254893568:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789762810.694072:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+21:3419:x1876702254893696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789762810.694082:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762810.694091:0:7992:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 21 pid: 5917 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.694097:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762810.694103:0:7992:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 21 pid: 5917 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.694106:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 21 pid: 5919 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.694129:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33fec90400/0x5915dfb1c1b5922c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59225 expref: 21 pid: 5917 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.694130:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 21 pid: 5919 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.694156:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762810.694157:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f7461600/0x5915dfb1c1b5923a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59233 expref: 20 pid: 5919 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.694171:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762810.694175:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789762810.694185:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254893824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789762810.694195:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762810.694201:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254893568:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (291us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762810.694202:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 19 pid: 5920 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.694217:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254893568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789762810.694221:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789762810.694221:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254893696:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (271us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762810.694223:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 19 pid: 5920 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762810.694243:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789762810.694247:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33fec91800/0x5915dfb1c1b5921e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5915dfb1c1b59217 expref: 18 pid: 5920 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762810.694258:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762810.694297:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254893696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789762810.694304:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:3420:x1876702254893824:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762810.694311:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789762810.694330:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254892928:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762810.694342:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f764bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254893824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789762810.694510:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1876702254893056:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762810.694516:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1789762810.694531:0:11680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762810.694555:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480384 00000100:00100000:2.0:1789762810.694578:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480384 00010000:00010000:2.0:1789762810.694596:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 13 pid: 5920 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762810.694616:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:2.0:1789762810.694622:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2353:x1876702246480384:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762810.694629:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762810.694633:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 13 pid: 5920 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.694641:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 13 pid: 5920 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.694656:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33c1663e00/0x5915dfb1c1b59256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894438c expref: 13 pid: 5920 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762810.694665:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762810.694670:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762810.694697:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6183be2-02c3-467f-81fa-2ef6138a604e+12:2353:x1876702246480384:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762810.694704:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:0.0:1789762810.694713:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480512 00000100:00100000:0.0:1789762810.694719:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480512 00010000:00010000:0.0:1789762810.694739:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 12 pid: 5919 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.694783:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1789762810.694793:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6183be2-02c3-467f-81fa-2ef6138a604e+12:2353:x1876702246480512:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762810.694801:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762810.694806:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 12 pid: 5919 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694817:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 12 pid: 5919 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694840:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f7461a00/0x5915dfb1c1b59241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944354 expref: 12 pid: 5919 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694852:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694859:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694868:0:5910:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694872:0:5910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694877:0:5910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694881:0:5910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694885:0:5910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762810.694887:0:5910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694892:0:5910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694905:0:5910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762810.694924:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762810.694925:0:11680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.694933:0:11680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762810.694940:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b33f0cee200/0x5915dfb1c1b59272 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762810.694955:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6183be2-02c3-467f-81fa-2ef6138a604e+11:2353:x1876702246480512:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 164us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762810.694963:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00010000:00010000:0.0:1789762810.746839:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789762811.747860:0:11874:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789762811.770853:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762811.971716:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762811.971782:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480640 00000100:00100000:2.0:1789762811.971791:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480640 00000100:00100000:2.0:1789762811.971841:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:2.0:1789762811.971850:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+11:5433:x1876702246480640:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762811.971864:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762811.971881:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f7461200/0x5915dfb1c1b59279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443b6 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.971904:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f7461200/0x5915dfb1c1b59279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443b6 expref: 12 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.971912:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f7461200/0x5915dfb1c1b59279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443b6 expref: 12 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762811.971920:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461200, rc 0) 00000100:00100000:2.0:1789762811.971965:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+12:5433:x1876702246480640:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762811.971969:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:2.0:1789762811.972830:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762811.972882:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480768 00000100:00100000:0.0:1789762811.972889:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480768 00000100:00100000:0.0:1789762811.972928:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:0.0:1789762811.972939:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+12:5433:x1876702246480768:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762811.973067:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+12:5433:x1876702246480768:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762811.973077:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:1.0:1789762811.973642:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762811.973677:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246480896 00000100:00100000:2.0:1789762811.973692:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246480896 00000100:00100000:2.0:1789762811.973715:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:2.0:1789762811.973720:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+12:5433:x1876702246480896:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762811.973807:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+12:5433:x1876702246480896:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 86us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762811.973813:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:3.0:1789762811.975799:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762811.975848:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481024 00000100:00100000:0.0:1789762811.975855:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481024 00000100:00100000:0.0:1789762811.975886:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:0.0:1789762811.975893:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+12:5433:x1876702246481024:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789762811.975900:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762811.975909:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443bd expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.975923:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443bd expref: 13 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.975930:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f0cee800/0x5915dfb1c1b59280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443bd expref: 13 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762811.975945:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee800, rc 0) 00000100:00100000:0.0:1789762811.975970:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:5433:x1876702246481024:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 78us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762811.975975:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:0.0:1789762811.976579:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762811.976621:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481152 00000100:00100000:2.0:1789762811.976626:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481152 00000100:00100000:2.0:1789762811.976649:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:2.0:1789762811.976654:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:5433:x1876702246481152:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789762811.976710:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:5433:x1876702246481152:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762811.976715:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:1.0:1789762811.977309:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762811.977345:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481280 00000100:00100000:0.0:1789762811.977350:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481280 00000100:00100000:0.0:1789762811.977375:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:0.0:1789762811.977385:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:5433:x1876702246481280:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762811.977442:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:5433:x1876702246481280:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762811.977448:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 208 10000000:01000000:3.0:1789762812.284007:0:5922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789762812.284017:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33fecdc800 from 7 10000000:01000000:3.0:1789762812.284025:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789762812.284099:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b59287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762812.284116:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b59287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762812.284132:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b59287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762812.284168:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254893952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.284285:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762812.284359:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254893952 00000100:00100000:2.0:1789762812.284371:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254893952 00000100:00100000:3.0:1789762812.284377:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37300 going to sleep for 11 seconds 00000100:00100000:2.0:1789762812.284447:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789762812.284462:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+16:5922:x1876702254893952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762812.284478:0:5919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762812.284495:0:5919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f7460e00/0x5915dfb1c1b5928e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59287 expref: -99 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.284522:0:5919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f7460e00/0x5915dfb1c1b5928e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59287 expref: 17 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.284533:0:5919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f7460e00/0x5915dfb1c1b5928e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59287 expref: 17 pid: 5919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.284570:0:5919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460e00, rc 0) 00000100:00100000:2.0:1789762812.284623:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254893952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.284630:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789762812.284669:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254893952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762812.284692:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b59287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5928e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762812.284702:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b59287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5928e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762812.284809:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.284837:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762812.284870:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37300 going to sleep for 11 seconds 00000100:00100000:1.0:1789762812.284894:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894080 00000100:00100000:1.0:1789762812.284910:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894080 00000100:00100000:1.0:1789762812.284961:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789762812.284971:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254894080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789762812.285140:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254894080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762812.285148:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789762812.285167:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.285206:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.285278:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762812.285301:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37300 going to sleep for 11 seconds 00000100:00100000:2.0:1789762812.285323:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894208 00000100:00100000:2.0:1789762812.285329:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894208 00000100:00100000:2.0:1789762812.285363:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789762812.285373:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254894208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762812.285482:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254894208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.285489:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789762812.285532:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789762812.287811:0:11923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789762812.287937:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789762812.288005:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789762812.288018:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b59287 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5928e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.288032:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33fec91800/0x5915dfb1c1b59287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5928e expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789762812.288044:0:5922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789762812.288047:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33f46f3000 from 7 10000000:01000000:0.0:1789762812.288050:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789762812.288091:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.288100:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.288116:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762812.288136:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789762812.288183:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762812.288223:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f769fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762812.288226:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894336 00000100:00100000:1.0:1789762812.288234:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894336 00000100:00100000:1.0:1789762812.288282:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789762812.288294:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+17:5922:x1876702254894336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789762812.288313:0:5920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762812.288324:0:5920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b5929c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b59295 expref: -99 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762812.288343:0:5920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b5929c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b59295 expref: 18 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762812.288352:0:5920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33c1662c00/0x5915dfb1c1b5929c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b59295 expref: 18 pid: 5920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762812.288359:0:5920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662c00, rc 0) 00000100:00100000:1.0:1789762812.288397:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254894336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762812.288403:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789762812.288431:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789762812.288447:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5929c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.288455:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b5929c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762812.288514:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762812.288562:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762812.288591:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f769fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762812.288608:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894464 00000100:00100000:1.0:1789762812.288613:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894464 00000100:00100000:1.0:1789762812.288644:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789762812.288654:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254894464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789762812.288740:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254894464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762812.288745:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789762812.288795:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762812.288839:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789762812.288894:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762812.288933:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894592 00000100:00100000:1.0:1789762812.288940:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894592 00000100:00100000:0.0:1789762812.288974:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f769fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762812.289009:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789762812.289022:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254894592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789762812.289111:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254894592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762812.289128:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789762812.289146:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789762812.289744:0:11925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789762812.290079:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789762812.290112:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789762812.290123:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59295 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5929c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762812.290136:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33f0cefc00/0x5915dfb1c1b59295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b5929c expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789762812.290149:0:5922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789762812.290153:0:5922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b33c8a8a800 from 7 10000000:01000000:3.0:1789762812.290156:0:5922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789762812.290188:0:5922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91600/0x5915dfb1c1b592a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762812.290195:0:5922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9b33fec91600/0x5915dfb1c1b592a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762812.290203:0:5922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9b33fec91600/0x5915dfb1c1b592a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762812.290336:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.290380:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762812.290425:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894720 00000100:00100000:2.0:1789762812.290432:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894720 00000100:00100000:3.0:1789762812.290434:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37300 going to sleep for 11 seconds 00000100:00100000:2.0:1789762812.290468:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789762812.290477:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+18:5922:x1876702254894720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789762812.290486:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762812.290496:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b33f7461e00/0x5915dfb1c1b592aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5915dfb1c1b592a3 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.290511:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b33f7461e00/0x5915dfb1c1b592aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5915dfb1c1b592a3 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.290519:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b33f7461e00/0x5915dfb1c1b592aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5915dfb1c1b592a3 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762812.290525:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461e00, rc 0) 00000100:00100000:2.0:1789762812.290580:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254894720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.290585:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789762812.290612:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789762812.290625:0:5922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9b33fec91600/0x5915dfb1c1b592a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b592aa expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762812.290638:0:5922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9b33fec91600/0x5915dfb1c1b592a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5915dfb1c1b592aa expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762812.290686:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.290723:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762812.290843:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37300 going to sleep for 11 seconds 00000100:00100000:0.0:1789762812.291004:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894848 00000100:00100000:0.0:1789762812.291010:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894848 00000100:00100000:0.0:1789762812.291047:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789762812.291054:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254894848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789762812.291126:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254894848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762812.291134:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789762812.291165:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.291202:0:5922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789762812.291262:0:5922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762812.291282:0:5922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37300 going to sleep for 11 seconds 00000100:00100000:2.0:1789762812.291303:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254894976 00000100:00100000:2.0:1789762812.291309:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254894976 00000100:00100000:2.0:1789762812.291344:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789762812.291351:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254894976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789762812.291423:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:5922:x1876702254894976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.291429:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789762812.291441:0:5922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:5922:1876702254894976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789762812.292051:0:11926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789762812.292109:0:5922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789762812.292135:0:5922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789762812.292144:0:5922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9b33fec91600/0x5915dfb1c1b592a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b592aa expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762812.292153:0:5922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9b33fec91600/0x5915dfb1c1b592a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5915dfb1c1b592aa expref: -99 pid: 5922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762812.731883:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254895104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762812.731958:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762812.731966:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254895360:0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.732034:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762812.732078:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254895872:0@lo:400:kworker.0 00000100:00100000:1.0:1789762812.732086:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254895616:0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.732120:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762812.732146:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254895232:0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.732186:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762812.732200:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254895488:0@lo:400:kworker.0 00000100:00100000:1.0:1789762812.732217:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762812.732244:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762812.732329:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254895744:0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.732368:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254895104 00000100:00100000:2.0:1789762812.732376:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254895104 00000100:00100000:1.0:1789762812.732380:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762812.732476:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762812.732477:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254895360 00000100:00100000:1.0:1789762812.732485:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254895360 00000100:00100000:2.0:1789762812.732495:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254895104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789762812.732530:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762812.732572:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254895488 00000100:00100000:1.0:1789762812.732578:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254895488 00000100:00100000:2.0:1789762812.732594:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254895104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762812.732595:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254895232 00000100:00100000:0.0:1789762812.732603:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254895232 00000100:00100000:2.0:1789762812.732605:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789762812.732607:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254895744 00000100:00100000:1.0:1789762812.732612:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254895744 00000100:00100000:2.0:1789762812.732642:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789762812.732655:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789762812.732660:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254895360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762812.732663:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789762812.732670:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254895488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762812.732678:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254895232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.732723:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254895360:12345-0@lo:400:kworker.0 Request processed in 68us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.732732:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789762812.732737:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254895488:12345-0@lo:400:kworker.0 Request processed in 70us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762812.732775:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789762812.732785:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789762812.732795:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254895232:12345-0@lo:400:kworker.0 Request processed in 119us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.732797:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254895744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762812.732813:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789762812.732852:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254895232:0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.732864:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254895744:12345-0@lo:400:kworker.0 Request processed in 71us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.732872:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789762812.732881:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254895744:0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.732918:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254895872 00000100:00100000:2.0:1789762812.732923:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254895872 00000100:00080000:1.0:1789762812.732949:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762812.732956:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762812.732975:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789762812.732982:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762812.732993:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254895872:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789762812.733053:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f47fbb80 x1876702254895104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762812.733059:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254895872:12345-0@lo:400:kworker.0 Request processed in 72us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762812.733080:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789762812.733090:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254895104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762812.733111:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254895616 00000100:00100000:0.0:1789762812.733118:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254895616 00000100:00080000:1.0:1789762812.733148:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762812.733185:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789762812.733189:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254895488:0@lo:400:kworker.0 00000100:00100000:0.0:1789762812.733203:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254895616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762812.733215:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254895360:0@lo:400:kworker.0 00010000:00080000:2.0:1789762812.733248:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f7592300 x1876702254895872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789762812.733259:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254895872:0@lo:400:kworker.0 00000100:00100000:0.0:1789762812.733277:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254895616:12345-0@lo:400:kworker.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762812.733288:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789762812.733314:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f7593480 x1876702254895616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789762828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789762812.733325:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254895616:0@lo:400:kworker.0 00010000:00010000:0.0:1789762812.794898:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762813.280016:0:12026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: finish setup 16:20:13 (1789762813) === 00000100:00100000:3.0:1789762813.306073:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762813.306123:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481408 00000100:00100000:1.0:1789762813.306135:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481408 00000100:00080000:2.0:1789762813.306186:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762813.306213:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:1.0:1789762813.306228:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:7449:x1876702246481408:12345-192.168.203.36@tcp:37:bash.0 00000100:00100000:0.0:1789762813.308633:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:7449:x1876702246481408:12345-192.168.203.36@tcp:37:bash.0 Request processed in 2405us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.308642:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:2.0:1789762813.314414:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.314465:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481536 00000100:00100000:3.0:1789762813.314473:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481536 00000100:00100000:3.0:1789762813.314518:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1789762813.314528:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9914:x1876702246481536:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762813.314553:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762813.314604:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90000/0x5915dfb1c1b592b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443c4 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314657:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314677:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314689:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314711:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314716:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314721:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314792:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314798:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314803:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314808:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec91200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762813.314812:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314817:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314826:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:3.0:1789762813.314834:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.314838:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314843:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91200/0x5915dfb1c1b592b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314851:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314855:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314860:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314864:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762813.314865:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314869:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314874:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xceb91eaa (ffff9b33e2f49c00) 00010000:00010000:3.0:1789762813.314876:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.314878:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314882:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90c00/0x5915dfb1c1b592bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314906:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90000/0x5915dfb1c1b592b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443c4 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314923:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:3.0:1789762813.314925:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.314928:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90000/0x5915dfb1c1b592b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443c4 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.314935:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90000, rc 0) 00000100:00100000:3.0:1789762813.314971:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9914:x1876702246481536:12345-192.168.203.36@tcp:101:rm.0 Request processed in 446us (561us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762813.314978:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1789762813.315640:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.315673:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.315676:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481792 00000100:00100000:0.0:1789762813.315681:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481792 00000100:00100000:3.0:1789762813.315696:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762813.315709:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481664 00000100:00100000:2.0:1789762813.315715:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481664 00000100:00100000:0.0:1789762813.315730:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:3.0:1789762813.315731:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.315744:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246481792:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762813.315786:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:2.0:1789762813.315796:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246481664:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762813.315797:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246482048 00000100:00100000:0.0:1789762813.315807:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246481792:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762813.315807:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246482048 00000100:00100000:0.0:1789762813.315816:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:2.0:1789762813.315835:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246481664:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 41us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762813.315841:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:3.0:1789762813.315857:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246481920 00000100:00100000:3.0:1789762813.315862:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246481920 00000100:00100000:0.0:1789762813.315866:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:0.0:1789762813.315877:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246482048:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762813.315906:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:0.0:1789762813.315911:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246482048:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762813.315923:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246481920:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762813.315924:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00080000:0.0:1789762813.315948:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762813.315954:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762813.315958:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762813.315963:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246481920:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 46us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762813.315969:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1789762813.316266:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.316300:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246482176 00000100:00100000:0.0:1789762813.316305:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246482176 00000100:00100000:0.0:1789762813.316338:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:0.0:1789762813.316346:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9914:x1876702246482176:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1789762813.316354:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.316364:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443cb expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316404:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316412:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316420:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316448:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316454:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316459:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316476:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316481:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316486:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316489:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cefa00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.316492:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316505:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316512:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:0.0:1789762813.316515:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.316517:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316521:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316530:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316535:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316553:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316559:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.316562:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316566:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316573:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x59b4378f (ffff9b33fed74900) 00010000:00010000:0.0:1789762813.316575:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.316577:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316590:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316609:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443cb expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316616:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:0.0:1789762813.316618:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.316621:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443cb expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.316627:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef200, rc 0) 00000100:00100000:0.0:1789762813.316654:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9914:x1876702246482176:12345-192.168.203.36@tcp:101:rm.0 Request processed in 310us (389us total) trans 0 rc 301/301 00000100:00100000:0.0:1789762813.316659:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:2.0:1789762813.317737:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.317799:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246482304 00000100:00100000:3.0:1789762813.317805:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246482304 00000100:00100000:3.0:1789762813.317835:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1789762813.317843:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9914:x1876702246482304:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762813.317856:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762813.317864:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90400/0x5915dfb1c1b592db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443d2 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317890:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317897:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317902:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317938:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317945:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317950:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317964:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317969:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317973:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317977:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec91e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762813.317984:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317988:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.317996:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:3.0:1789762813.317998:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.318000:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318004:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec91e00/0x5915dfb1c1b592e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318012:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318017:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318021:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318025:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762813.318027:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318031:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318035:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5948ff0e (ffff9b33e2f49500) 00010000:00010000:3.0:1789762813.318037:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.318044:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318048:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b592e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318066:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90400/0x5915dfb1c1b592db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443d2 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318073:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:3.0:1789762813.318075:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.318077:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec90400/0x5915dfb1c1b592db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443d2 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.318083:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec90400, rc 0) 00000100:00100000:3.0:1789762813.318113:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9914:x1876702246482304:12345-192.168.203.36@tcp:101:rm.0 Request processed in 273us (378us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762813.318118:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1789762813.368134:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762813.368185:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246482432 00000100:00100000:1.0:1789762813.368194:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246482432 00000100:00100000:1.0:1789762813.368242:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:1.0:1789762813.368251:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9925:x1876702246482432:12345-192.168.203.36@tcp:700:mkdir.0 00000100:00100000:1.0:1789762813.368323:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9925:x1876702246482432:12345-192.168.203.36@tcp:700:mkdir.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762813.368333:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:2.0:1789762813.369280:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.369373:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246482688 00000100:00100000:0.0:1789762813.369378:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246482688 00000100:00100000:0.0:1789762813.369410:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1789762813.369416:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9925:x1876702246482688:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:0.0:1789762813.369452:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762813.369472:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b59122 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894433f expref: 6 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.369488:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2ab300) 00010000:00010000:0.0:1789762813.369495:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762813.369559:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.369582:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.369589:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.369624:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.369629:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.369634:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762813.370130:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789762813.370140:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.370147:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.370154:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.370160:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.370164:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.370172:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.370192:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74900) 00010000:00010000:0.0:1789762813.370195:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.370199:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.370206:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b592f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762813.370220:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005076a82c reply state 0000000007551b0d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762813.370229:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762813.370295:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:9925:x1876702246482688:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 879us (1017us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789762813.370301:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00010000:00010000:3.0:1789762813.370938:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.370950:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.370957:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.370963:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762813.370966:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.370981:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.370993:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b33fed74800) 00010000:00010000:3.0:1789762813.370996:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.370999:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.371006:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b592f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.373742:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.373807:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246482816 00000100:00100000:0.0:1789762813.373814:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246482816 00000100:00100000:0.0:1789762813.373851:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:0.0:1789762813.373864:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9926:x1876702246482816:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:0.0:1789762813.373876:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.373886:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443d9 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.373920:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b59305 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.373928:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b59305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.373943:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b59305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762813.373961:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762813.373964:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762813.373984:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b59305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.374000:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b592fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443d9 expref: 8 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.374010:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b59305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443d9 expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.374016:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74d00) 00010000:00010000:0.0:1789762813.374018:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762813.374020:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef800, rc 0) 00000100:00100000:0.0:1789762813.374046:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:9926:x1876702246482816:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 190us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.374051:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:2.0:1789762813.374810:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.374850:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246483072 00000100:00100000:3.0:1789762813.374854:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246483072 00000100:00100000:3.0:1789762813.374883:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1789762813.374890:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:9926:x1876702246483072:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:3.0:1789762813.374910:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762813.374919:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b59305 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443d9 expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.374928:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74d00) 00010000:00010000:3.0:1789762813.374933:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762813.374944:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.374950:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.374955:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762813.375068:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011295d6d reply state 00000000917ece66 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762813.375074:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762813.375078:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789762813.375115:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:9926:x1876702246483072:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 225us (307us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789762813.375120:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00010000:00010000:0.0:1789762813.375639:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.375648:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.375652:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.375664:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.375666:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.375671:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.375677:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:0.0:1789762813.375679:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762813.375681:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.375685:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2200/0x5915dfb1c1b5930c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.382163:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.382195:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246483200 00000100:00100000:0.0:1789762813.382200:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246483200 00000100:00100000:0.0:1789762813.382228:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1789762813.382234:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:9927:x1876702246483200:12345-192.168.203.36@tcp:101:chown.0 00010000:00010000:0.0:1789762813.382245:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.382254:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b59313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443e0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.382288:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5931a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.382299:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5931a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.382308:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5931a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762813.382336:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762813.382338:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762813.382359:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5931a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.382373:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b59313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443e0 expref: 9 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.382383:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5931a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443e0 expref: 8 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.382389:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:0.0:1789762813.382391:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762813.382393:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee200, rc 0) 00000100:00100000:0.0:1789762813.382420:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:9927:x1876702246483200:12345-192.168.203.36@tcp:101:chown.0 Request processed in 186us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.382425:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1789762813.383072:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.383102:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246483328 00000100:00100000:0.0:1789762813.383107:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246483328 00000100:00100000:0.0:1789762813.383131:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:0.0:1789762813.383136:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:9927:x1876702246483328:12345-192.168.203.36@tcp:101:chown.0 00010000:00010000:0.0:1789762813.383142:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.383148:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b59321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443e7 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383171:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383186:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383192:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383200:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383205:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383209:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383243:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b59336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383248:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b59336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383252:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b59336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762813.383271:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762813.383274:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762813.383284:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b59336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383294:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383311:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383318:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383322:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.383324:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383329:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383335:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:0.0:1789762813.383336:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.383339:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383343:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383350:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383354:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383357:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383361:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.383367:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383371:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383376:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b33fed74900) 00010000:00010000:0.0:1789762813.383377:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.383379:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383382:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5932f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383399:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b59321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443e7 expref: 10 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383406:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b59336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443e7 expref: 9 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.383410:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:0.0:1789762813.383411:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762813.383413:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef000, rc 0) 00000100:00100000:0.0:1789762813.383437:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:9927:x1876702246483328:12345-192.168.203.36@tcp:101:chown.0 Request processed in 301us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.383442:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:2.0:1789762813.384390:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.384422:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246483584 00000100:00100000:3.0:1789762813.384427:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246483584 00000100:00100000:3.0:1789762813.384453:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:3.0:1789762813.384459:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:9927:x1876702246483584:12345-192.168.203.36@tcp:36:chown.0 00010000:00010000:3.0:1789762813.384477:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762813.384487:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b59336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443e7 expref: 9 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.384496:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:3.0:1789762813.384500:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762813.384510:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.384516:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.384521:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762813.385821:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1789762813.385866:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023841d12 reply state 00000000469857bd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762813.385875:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762813.385879:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1789762813.385917:0:5924:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789762813.385926:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:9927:x1876702246483584:12345-192.168.203.36@tcp:36:chown.0 Request processed in 1467us (1538us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789762813.385932:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00010000:00010000:0.0:1789762813.385944:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.385952:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.385962:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.385966:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.385969:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.385973:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.385980:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:0.0:1789762813.385982:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762813.385984:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.385989:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3200/0x5915dfb1c1b5933d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.390910:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.390981:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246483712 00000100:00100000:0.0:1789762813.390988:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246483712 00000100:00100000:0.0:1789762813.391025:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:0.0:1789762813.391032:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:9928:x1876702246483712:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:0.0:1789762813.391043:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.391053:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b59344 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443ee expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762813.391526:0:5926:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 444us 00010000:00010000:2.0:1789762813.396594:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396608:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396618:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396631:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396638:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396655:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396736:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396745:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396776:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762813.396801:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762813.396805:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762813.396832:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396843:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396849:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396856:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396863:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762813.396867:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396875:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396891:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:2.0:1789762813.396894:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762813.396898:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396906:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5934b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396917:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396924:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396931:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396936:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762813.396940:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396947:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396954:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b33ed2a9000) 00010000:00010000:2.0:1789762813.396957:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762813.396960:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.396966:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59352 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.397003:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b59344 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443ee expref: 8 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.397017:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443ee expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.397025:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:2.0:1789762813.397027:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789762813.397030:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460a00, rc 0) 00000100:00100000:2.0:1789762813.397071:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:9928:x1876702246483712:12345-192.168.203.36@tcp:101:touch.500 Request processed in 6038us (6162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762813.397079:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1789762813.398024:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.398059:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246483968 00000100:00100000:0.0:1789762813.398064:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246483968 00000100:00100000:0.0:1789762813.398093:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:0.0:1789762813.398104:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:9928:x1876702246483968:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:0.0:1789762813.398113:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.398120:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b59360 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443f5 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398161:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398168:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398173:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398216:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398221:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398225:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762813.398435:0:9183:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789762813.398518:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b59375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398524:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b59375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398529:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b59375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398571:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398576:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398580:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398583:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.398585:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398589:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398595:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:0.0:1789762813.398596:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.398599:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398602:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b59367 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762813.398609:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096779a79 reply state 00000000b41976b2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762813.398613:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789762813.398628:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b59360 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443f5 expref: 10 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398646:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b59375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443f5 expref: 9 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.398651:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33fed74100) 00010000:00010000:0.0:1789762813.398653:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762813.398654:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee000, rc 0) 00000100:00100000:0.0:1789762813.398688:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:9928:x1876702246483968:12345-192.168.203.36@tcp:101:touch.500 Request processed in 582us (662us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789762813.398695:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00010000:00010000:0.0:1789762813.399279:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.399287:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.399292:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.399296:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.399298:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.399302:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.399309:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc5f1094c (ffff9b33fed74900) 00010000:00010000:0.0:1789762813.399311:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.399313:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.399323:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5936e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.400130:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.400168:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246484224 00000100:00100000:3.0:1789762813.400205:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246484224 00000100:00100000:3.0:1789762813.400234:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:3.0:1789762813.400241:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:9928:x1876702246484224:12345-192.168.203.36@tcp:36:touch.500 00010000:00010000:3.0:1789762813.400262:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762813.400272:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b59375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443f5 expref: 9 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.400281:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33fed74100) 00010000:00010000:3.0:1789762813.400286:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762813.400304:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.400311:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.400316:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762813.400361:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008dc744c reply state 00000000df6627d2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762813.400372:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762813.400415:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:9928:x1876702246484224:12345-192.168.203.36@tcp:36:touch.500 Request processed in 174us (286us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789762813.400421:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00010000:00010000:0.0:1789762813.400917:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.400925:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.400929:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.400933:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.400936:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.400940:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.400947:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33e2f49f00) 00010000:00010000:0.0:1789762813.400949:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.400951:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.400955:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59383 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.401066:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.401100:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246484352 00000100:00100000:0.0:1789762813.401104:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246484352 00000100:00100000:0.0:1789762813.401130:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:0.0:1789762813.401136:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:9928:x1876702246484352:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:0.0:1789762813.401150:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.401158:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5938a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789443fc expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.401180:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5938a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443fc expref: 10 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.401187:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5938a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443fc expref: 10 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.401198:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:0.0:1789762813.401200:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789762813.401202:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef000, rc 0) 00000100:00100000:0.0:1789762813.401228:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:9928:x1876702246484352:12345-192.168.203.36@tcp:101:touch.500 Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.401235:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:3.0:1789762813.402025:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.402094:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246484480 00000100:00100000:0.0:1789762813.402100:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246484480 00000100:00100000:0.0:1789762813.402124:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:0.0:1789762813.402129:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876702246484480:12345-192.168.203.36@tcp:8:touch.500 00010000:00080000:0.0:1789762813.402148:0:6909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 115 last 0 00000020:00000080:0.0:1789762813.402166:0:6909:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b59391 00002000:00100000:0.0:1789762813.402176:0:6909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f07ac6c5-9215-4651-bbbc-5b452d5bdd86/ffff9b33f46c1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789762813.402183:0:6909:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789762813.402220:0:6909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789762813.402240:0:6909:0:(import.c:65:import_set_state_nolock()) ffff9b33fedbf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789762813.402280:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246484480:12345-192.168.203.36@tcp:8:touch.500 Request processed in 149us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.402288:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:2.0:1789762813.402982:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.403015:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246484608 00000100:00100000:0.0:1789762813.403020:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246484608 00000100:00080000:2.0:1789762813.403056:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762813.403064:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:0.0:1789762813.403072:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:0:x1876702246484608:12345-192.168.203.36@tcp:2:touch.500 00000001:00080000:2.0:1789762813.405802:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789762813.405808:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000100:00100000:0.0:1789762813.405888:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:0:x1876702246484608:12345-192.168.203.36@tcp:2:touch.500 Request processed in 2815us (2903us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789762813.405897:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:2.0:1789762813.406699:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.406731:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246484864 00000100:00100000:3.0:1789762813.406737:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246484864 00000100:00100000:3.0:1789762813.406801:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:3.0:1789762813.406809:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:9928:x1876702246484864:12345-192.168.203.36@tcp:35:touch.500 00000100:00100000:3.0:1789762813.406933:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:9928:x1876702246484864:12345-192.168.203.36@tcp:35:touch.500 Request processed in 125us (233us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789762813.406938:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:3.0:1789762813.411094:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.411124:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246484992 00000100:00100000:0.0:1789762813.411130:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246484992 00000100:00100000:0.0:1789762813.411162:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1789762813.411172:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:9929:x1876702246484992:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1789762813.411183:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.411194:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944403 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.411231:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5939f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.411242:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5939f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.411250:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5939f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762813.411271:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762813.411279:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762813.411309:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5939f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.411324:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b59398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944403 expref: 13 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.411334:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5939f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944403 expref: 12 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.411340:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:0.0:1789762813.411342:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762813.411344:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef200, rc 0) 00000100:00100000:0.0:1789762813.411373:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:9929:x1876702246484992:12345-192.168.203.36@tcp:101:rm.0 Request processed in 203us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.411380:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:2.0:1789762813.412457:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.412499:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246485248 00000100:00100000:3.0:1789762813.412505:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246485248 00000100:00100000:3.0:1789762813.412532:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:3.0:1789762813.412554:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:9929:x1876702246485248:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762813.412563:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762813.412572:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b593a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894440a expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762813.412609:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789762813.412657:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b593a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894440a expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.412669:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:3.0:1789762813.412678:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762813.412683:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b593a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894440a expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.412694:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2600, rc 0) 00000100:00100000:3.0:1789762813.412723:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:9929:x1876702246485248:12345-192.168.203.36@tcp:101:rm.0 Request processed in 185us (267us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789762813.412728:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:2.0:1789762813.414112:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.414147:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246485376 00000100:00100000:0.0:1789762813.414152:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246485376 00000100:00100000:0.0:1789762813.414181:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:0.0:1789762813.414188:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0aff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:9929:x1876702246485376:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:0.0:1789762813.415675:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0aff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:9929:x1876702246485376:12345-192.168.203.36@tcp:37:rm.0 Request processed in 1485us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.415684:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1789762813.416966:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.416998:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246485632 00000100:00100000:3.0:1789762813.417004:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246485632 00000100:00100000:3.0:1789762813.417028:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:3.0:1789762813.417035:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:9929:x1876702246485632:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762813.417109:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:9929:x1876702246485632:12345-192.168.203.36@tcp:35:rm.0 Request processed in 74us (146us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789762813.417115:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:2.0:1789762813.417853:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.417886:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246485888 00000100:00100000:0.0:1789762813.417891:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246485888 00000100:00100000:0.0:1789762813.417929:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1789762813.417939:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:9929:x1876702246485888:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1789762813.417950:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762813.417966:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b593b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944411 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.418010:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b593bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.418018:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b593bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.418024:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b593bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762813.418029:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789762813.418067:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b593b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944411 expref: 17 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.418077:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b593bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944411 expref: 16 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.418082:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:0.0:1789762813.418084:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789762813.418086:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef800, rc 0) 00000100:00100000:0.0:1789762813.418114:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:9929:x1876702246485888:12345-192.168.203.36@tcp:101:rm.0 Request processed in 176us (260us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789762813.418121:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:2.0:1789762813.418974:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.419005:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246486016 00000100:00100000:0.0:1789762813.419010:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246486016 00000100:00100000:0.0:1789762813.419037:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:0.0:1789762813.419045:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:9929:x1876702246486016:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:0.0:1789762813.419080:0:9183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7384293376 00000100:00100000:0.0:1789762813.419111:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:9929:x1876702246486016:12345-192.168.203.36@tcp:41:rm.0 Request processed in 67us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762813.419119:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1789762813.419717:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762813.419773:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246486144 00000100:00100000:3.0:1789762813.419779:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246486144 00000100:00100000:3.0:1789762813.419807:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:3.0:1789762813.419815:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:9929:x1876702246486144:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762813.419823:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762813.419830:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b593c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944418 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419855:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419863:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419875:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419884:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419889:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419894:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419932:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b593de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419938:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b593de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419942:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b593de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762813.419957:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789762813.419960:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762813.419967:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b593de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419973:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b593de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419978:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419990:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419994:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.419999:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762813.420003:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420010:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420020:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:3.0:1789762813.420023:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.420027:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420033:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b593d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420045:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420052:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420058:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420062:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762813.420069:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420074:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420079:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc5f1094c (ffff9b33e2f49d00) 00010000:00010000:3.0:1789762813.420081:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762813.420083:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420087:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b593d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420105:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b593c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944418 expref: 18 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420112:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b593de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944418 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762813.420117:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:3.0:1789762813.420119:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762813.420120:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2800, rc 0) 00000100:00100000:3.0:1789762813.420147:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:9929:x1876702246486144:12345-192.168.203.36@tcp:101:rm.0 Request processed in 335us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762813.420152:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:2.0:1789762813.421144:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.421182:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246486400 00000100:00100000:0.0:1789762813.421187:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246486400 00000100:00100000:0.0:1789762813.421215:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:0.0:1789762813.421221:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:9929:x1876702246486400:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762813.421241:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762813.421251:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b593de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944418 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421263:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5938a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443fc expref: 16 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421269:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:0.0:1789762813.421276:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5939f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944403 expref: 15 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421282:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:0.0:1789762813.421284:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762813.421291:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421296:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421302:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421315:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421321:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421325:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421357:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421362:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421367:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789762813.421478:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789762813.421484:0:5926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 115858732606ns, next at 116858730981ns, rc = 0 00010000:00010000:0.0:1789762813.421514:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421520:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421526:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421531:0:5926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421558:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421562:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421576:0:5926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762813.421588:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421595:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421601:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421601:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762813.421607:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762813.421607:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421611:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421614:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762813.421618:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421618:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421625:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421628:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33fed74d00) 00010000:00010000:0.0:1789762813.421631:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762813.421634:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421636:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b33fed74d00) 00010000:00010000:2.0:1789762813.421638:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789762813.421642:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b593f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421642:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421649:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b593fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421655:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762813.421661:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762813.421663:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762813.421665:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762813.421667:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421673:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421679:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.421682:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421690:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421696:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:0.0:1789762813.421697:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.421699:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.421703:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b593e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762813.421710:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000702d51cb reply state 00000000686081cf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762813.421715:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762813.421772:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:9929:x1876702246486400:12345-192.168.203.36@tcp:36:rm.0 Request processed in 527us (604us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789762813.421782:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00010000:00010000:0.0:1789762813.422308:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.422325:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.422330:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.422333:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cefa00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.422336:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.422341:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.422347:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc5f1094c (ffff9b33fed74900) 00010000:00010000:0.0:1789762813.422349:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.422351:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.422355:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b593ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc5f1094c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762813.422718:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.422803:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246486656 00000100:00100000:0.0:1789762813.422808:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246486656 00000100:00100000:0.0:1789762813.422835:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:0.0:1789762813.422842:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:9929:x1876702246486656:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:0.0:1789762813.422920:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:9929:x1876702246486656:12345-192.168.203.36@tcp:35:rm.0 Request processed in 79us (203us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789762813.422926:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:2.0:1789762813.423593:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762813.423626:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246486912 00000100:00100000:0.0:1789762813.423636:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246486912 00000100:00100000:0.0:1789762813.423660:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:0.0:1789762813.423666:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:9929:x1876702246486912:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762813.423684:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762813.423693:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b593bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944411 expref: 16 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423705:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443ee expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423712:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:0.0:1789762813.423720:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5931a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789443e0 expref: 14 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423726:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:0.0:1789762813.423730:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762813.423739:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423745:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423778:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423788:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423793:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423806:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423836:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423841:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423845:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762813.423929:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789762813.423936:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423940:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423945:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423948:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.423950:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423954:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423959:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:0.0:1789762813.423961:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762813.423968:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423972:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b5940f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423983:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423987:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423991:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423994:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.423996:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.423999:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424004:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:0.0:1789762813.424005:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.424007:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424010:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b59401 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762813.424016:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029ac3f59 reply state 00000000d0b90826 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762813.424027:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762813.424057:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:9929:x1876702246486912:12345-192.168.203.36@tcp:36:rm.0 Request processed in 391us (465us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789762813.424063:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00010000:00010000:0.0:1789762813.424606:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424612:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424617:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424620:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762813.424622:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424626:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424632:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b33fed74400) 00010000:00010000:0.0:1789762813.424634:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762813.424636:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.424639:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643a00/0x5915dfb1c1b59408 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762813.818870:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789762814.331386:0:12075:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 16:20:14 (1789762814) 00000100:00100000:2.0:1789762814.729051:0:12123:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762814.729061:0:12123:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33fee79100 rate 10000 gen 0 00000100:00100000:2.0:1789762814.729094:0:12123:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762814.729097:0:12123:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33fee79b00 rate 10000 gen 0 00000100:00100000:2.0:1789762814.729207:0:12123:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X8, dynamic 0, field: uid, str: 500 00000100:00100000:2.0:1789762814.729223:0:12123:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762814.729228:0:12123:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X8, dynamic 0, field: uid, str: 500 00000100:00100000:2.0:1789762814.729234:0:12123:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33fee79600 rate 5 gen 0 00000100:00100000:2.0:1789762814.729239:0:12123:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762814.729243:0:12123:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X8, dynamic 0, field: uid, str: 500 00000100:00100000:2.0:1789762814.729247:0:12123:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33fee79d00 rate 5 gen 0 00000100:00100000:0.0:1789762814.740399:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.740484:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246487040 00000100:00100000:3.0:1789762814.740499:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246487040 00000100:00100000:3.0:1789762814.740600:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1789762814.740616:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10324:x1876702246487040:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:3.0:1789762814.740657:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762814.740685:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59416 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894441f expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.740794:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5941d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.740812:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5941d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.740830:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5941d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762814.740885:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762814.740890:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762814.740920:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5941d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.740952:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894441f expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.740976:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5941d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894441f expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.740987:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49f00) 00010000:00010000:3.0:1789762814.740991:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762814.740995:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e3c00, rc 0) 00000100:00100000:3.0:1789762814.741076:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:10324:x1876702246487040:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 463us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762814.741088:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1789762814.742876:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.742927:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246487296 00000100:00100000:3.0:1789762814.742935:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246487296 00000100:00100000:3.0:1789762814.742978:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:3.0:1789762814.742991:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:10324:x1876702246487296:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:3.0:1789762814.743032:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762814.743053:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5941d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894441f expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743069:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49f00) 00010000:00010000:3.0:1789762814.743090:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762814.743146:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743157:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743166:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743180:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743189:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743197:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762814.743834:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789762814.743845:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743867:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743875:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743883:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762814.743891:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743900:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743912:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:3.0:1789762814.743915:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762814.743919:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.743925:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59424 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762814.743940:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d231a22c reply state 00000000f21d6ae5 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.743951:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762814.744010:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10324:x1876702246487296:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 1023us (1135us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789762814.744019:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00010000:00010000:0.0:1789762814.744509:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.744523:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.744545:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.744550:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762814.744554:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.744561:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.744574:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33e2f49c00) 00010000:00010000:0.0:1789762814.744578:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762814.744583:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.744591:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b5942b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.748800:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.748831:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246487424 00000100:00100000:1.0:1789762814.748841:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246487424 00000100:00100000:1.0:1789762814.748886:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:1.0:1789762814.748895:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:10325:x1876702246487424:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762814.748915:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.748936:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59432 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944426 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.749016:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59439 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.749030:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.749039:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762814.749072:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762814.749074:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762814.749104:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.749124:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59432 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944426 expref: 17 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.749136:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59439 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944426 expref: 16 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.749142:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148e00) 00010000:00010000:1.0:1789762814.749144:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762814.749147:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662a00, rc 0) 00000100:00100000:1.0:1789762814.749195:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10325:x1876702246487424:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 302us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762814.749200:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1789762814.750191:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.750241:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246487680 00000100:00100000:3.0:1789762814.750250:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246487680 00000100:00100000:3.0:1789762814.750328:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:3.0:1789762814.750341:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10325:x1876702246487680:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762814.750354:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762814.750356:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762814.750374:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59439 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944426 expref: 16 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750394:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148e00) 00010000:00010000:3.0:1789762814.750407:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762814.750419:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b59440 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894442d expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750487:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750496:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750502:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750511:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750516:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750525:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750604:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750623:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750633:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762814.750644:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789762814.750659:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750665:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750670:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750674:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762814.750677:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750682:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750692:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33e2f49a00) 00010000:00010000:3.0:1789762814.750694:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762814.750696:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750701:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750722:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750732:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750737:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750740:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762814.750742:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750746:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750795:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49f00) 00010000:00010000:3.0:1789762814.750797:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762814.750800:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750804:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750822:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750827:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750832:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750836:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762814.750845:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750850:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750859:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33e2f49700) 00010000:00010000:3.0:1789762814.750861:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762814.750863:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750867:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b5944e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750888:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b59440 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894442d expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750896:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49f00) 00010000:00010000:3.0:1789762814.750897:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762814.750902:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b59440 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894442d expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.750913:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e3c00, rc 0) 00000100:00100000:3.0:1789762814.750952:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:10325:x1876702246487680:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 616us (764us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762814.750957:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:0.0:1789762814.751745:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.751831:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246487808 00000100:00100000:3.0:1789762814.751838:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246487808 00000100:00100000:3.0:1789762814.751875:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:3.0:1789762814.751884:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:10325:x1876702246487808:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762814.751899:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762814.751909:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b5945c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944434 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.751937:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2000/0x5915dfb1c1b59463 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.751944:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2000/0x5915dfb1c1b59463 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.751950:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2000/0x5915dfb1c1b59463 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762814.751966:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762814.751969:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762814.751980:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2000/0x5915dfb1c1b59463 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.751994:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b5945c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944434 expref: 17 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.752006:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2000/0x5915dfb1c1b59463 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944434 expref: 16 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.752012:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:3.0:1789762814.752015:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762814.752017:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2000, rc 0) 00000100:00100000:3.0:1789762814.752051:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10325:x1876702246487808:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 170us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762814.752056:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:0.0:1789762814.752893:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.752925:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246488064 00000100:00100000:1.0:1789762814.752932:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246488064 00000100:00100000:1.0:1789762814.752974:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:1.0:1789762814.752986:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10325:x1876702246488064:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762814.752997:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.753008:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5946a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894443b expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753045:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753054:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753060:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753069:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753074:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753078:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762814.753147:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789762814.753200:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753205:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753210:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753219:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.753222:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753227:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753237:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:1.0:1789762814.753239:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.753242:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753246:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753255:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753260:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753264:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753268:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.753270:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753274:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753288:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33d0148900) 00010000:00010000:1.0:1789762814.753290:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.753292:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753295:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753320:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5946a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894443b expref: 18 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753328:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:1.0:1789762814.753329:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762814.753332:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5946a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894443b expref: 18 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.753338:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663000, rc 0) 00000100:00100000:1.0:1789762814.753371:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:10325:x1876702246488064:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 389us (479us total) trans 4294967310 rc 301/301 00000100:00100000:1.0:1789762814.753377:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:0.0:1789762814.754205:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.754238:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246488320 00000100:00100000:3.0:1789762814.754245:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246488320 00000100:00100000:3.0:1789762814.754281:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:3.0:1789762814.754291:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:10325:x1876702246488320:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1789762814.754332:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.754342:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.754349:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762814.754438:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3cb5f0b reply state 0000000018b738bd transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.754445:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762814.754450:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1789762814.754505:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:10325:x1876702246488320:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 217us (302us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789762814.754513:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00010000:00010000:2.0:1789762814.754999:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.755008:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.755014:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.755019:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762814.755021:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.755025:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.755034:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33e2f49000) 00010000:00010000:2.0:1789762814.755036:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789762814.755039:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.755043:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2c00/0x5915dfb1c1b59486 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.755125:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.755160:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246488576 00000100:00100000:2.0:1789762814.755170:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246488576 00000100:00100000:2.0:1789762814.755207:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:0.0:1789762814.755212:0:5927:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789762814.755219:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:10325:x1876702246488576:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1789762814.755224:0:5927:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789762814.755340:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:10325:x1876702246488576:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 125us (214us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789762814.755349:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:0.0:1789762814.758792:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.758841:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246488704 00000100:00100000:1.0:1789762814.758847:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246488704 00000100:00100000:1.0:1789762814.758884:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:1.0:1789762814.758891:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:10326:x1876702246488704:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1789762814.758902:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.758911:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5948d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944442 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.758950:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.758958:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.758964:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.758973:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.758978:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.758985:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759016:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759021:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759028:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762814.759043:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789762814.759045:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762814.759057:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759073:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759077:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759081:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759087:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.759089:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759093:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759100:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:1.0:1789762814.759103:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.759105:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759109:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759116:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759120:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759125:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759134:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.759136:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759140:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759147:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33d0148900) 00010000:00010000:1.0:1789762814.759149:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.759152:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759156:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5949b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759176:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5948d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944442 expref: 21 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759184:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944442 expref: 20 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.759189:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33d0148600) 00010000:00010000:1.0:1789762814.759190:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762814.759191:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662000, rc 0) 00000100:00100000:1.0:1789762814.759223:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:10326:x1876702246488704:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 333us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762814.759228:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:1.0:1789762814.760237:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.760291:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246488960 00000100:00100000:0.0:1789762814.760296:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246488960 00000100:00100000:0.0:1789762814.760334:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1789762814.760347:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:10326:x1876702246488960:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:0.0:1789762814.760373:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762814.760388:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944442 expref: 20 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.760404:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33d0148600) 00010000:00010000:0.0:1789762814.760411:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762814.760429:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.760437:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.760444:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762814.760584:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000196d846c reply state 000000004259b6ff transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.760591:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789762814.760595:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000100:00100000:0.0:1789762814.760642:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:10326:x1876702246488960:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 300us (407us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789762814.760651:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00010000:00010000:1.0:1789762814.761199:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.761206:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.761211:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.761216:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.761220:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.761228:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.761239:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74400) 00010000:00010000:1.0:1789762814.761242:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789762814.761247:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.761254:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.773850:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.773897:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246489088 00000100:00100000:0.0:1789762814.773907:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246489088 00000100:00100000:0.0:1789762814.773965:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1789762814.773986:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:10330:x1876702246489088:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:0.0:1789762814.774008:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762814.774024:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643c00/0x5915dfb1c1b594b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944449 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774077:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774092:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774103:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774119:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774127:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774135:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774200:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774209:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774217:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762814.774259:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789762814.774263:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762814.774300:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774313:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774321:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774329:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774336:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762814.774341:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774349:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774361:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:0.0:1789762814.774365:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762814.774369:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774377:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b594b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774389:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774409:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774416:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774422:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762814.774426:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774434:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774444:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33fed74800) 00010000:00010000:0.0:1789762814.774447:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762814.774450:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774456:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b594be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774485:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643c00/0x5915dfb1c1b594b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944449 expref: 22 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774498:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944449 expref: 21 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.774506:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:0.0:1789762814.774508:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762814.774517:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4642600, rc 0) 00000100:00100000:0.0:1789762814.774586:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:10330:x1876702246489088:12345-192.168.203.36@tcp:101:touch.0 Request processed in 603us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.774594:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1789762814.776026:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.776062:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246489344 00000100:00100000:1.0:1789762814.776067:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246489344 00000100:00100000:1.0:1789762814.776099:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:1.0:1789762814.776107:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:10330:x1876702246489344:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:1.0:1789762814.776117:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.776127:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b594cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944450 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776191:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776203:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776212:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776226:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776234:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776242:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762814.776514:0:5926:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00000004:00080000:1.0:1789762814.776519:0:5926:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789762814.776640:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776647:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776653:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776673:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776684:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776688:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776691:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.776693:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776698:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776703:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:1.0:1789762814.776706:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.776708:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776712:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b594d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762814.776720:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001a20266 reply state 00000000824fa190 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.776725:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762814.776741:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b594cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944450 expref: 24 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776777:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944450 expref: 23 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.776801:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33d0148700) 00010000:00010000:1.0:1789762814.776805:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762814.776808:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662000, rc 0) 00000100:00100000:1.0:1789762814.776863:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:10330:x1876702246489344:12345-192.168.203.36@tcp:101:touch.0 Request processed in 754us (834us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789762814.776876:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00010000:00010000:1.0:1789762814.777616:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.777626:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.777636:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.777643:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.777648:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.777655:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.777667:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3950208a (ffff9b33d0148900) 00010000:00010000:1.0:1789762814.777671:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.777678:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.777685:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b594da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.778114:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.778150:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246489600 00000100:00100000:1.0:1789762814.778156:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246489600 00000100:00100000:1.0:1789762814.778195:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:1.0:1789762814.778201:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:10330:x1876702246489600:12345-192.168.203.36@tcp:36:touch.0 00010000:00010000:1.0:1789762814.778228:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762814.778241:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b594e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944450 expref: 23 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.778254:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33d0148700) 00010000:00010000:1.0:1789762814.778260:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762814.778283:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.778290:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.778295:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762814.778336:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4495e19 reply state 00000000f4c37f78 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.778341:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762814.778392:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:10330:x1876702246489600:12345-192.168.203.36@tcp:36:touch.0 Request processed in 189us (276us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789762814.778400:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00010000:00010000:0.0:1789762814.778989:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.778999:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779007:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779014:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762814.779019:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779027:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779041:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33d0148100) 00010000:00010000:0.0:1789762814.779044:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762814.779049:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779057:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b594ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.779094:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.779123:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246489728 00000100:00100000:0.0:1789762814.779129:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246489728 00000100:00100000:0.0:1789762814.779178:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:0.0:1789762814.779190:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:10330:x1876702246489728:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:0.0:1789762814.779204:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762814.779219:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642e00/0x5915dfb1c1b594f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944457 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779252:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642e00/0x5915dfb1c1b594f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944457 expref: 24 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779264:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642e00/0x5915dfb1c1b594f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944457 expref: 24 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.779280:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:0.0:1789762814.779283:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789762814.779288:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4642e00, rc 0) 00000100:00100000:0.0:1789762814.779326:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:10330:x1876702246489728:12345-192.168.203.36@tcp:101:touch.0 Request processed in 135us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.779334:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:1.0:1789762814.779862:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f764b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254896000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762814.779924:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762814.779971:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254896000 00000100:00100000:0.0:1789762814.779976:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254896000 00000100:00100000:0.0:1789762814.780048:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789762814.780063:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254896000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762814.780086:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762814.780146:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254896000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.780157:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789762814.780180:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b33f764b800 x1876702254896000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789762830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789762814.780184:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762814.780208:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f764b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254896000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762814.780282:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.780334:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246489856 00000100:00100000:0.0:1789762814.780339:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246489856 00000100:00100000:1.0:1789762814.780347:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.780385:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246490112 00000100:00100000:1.0:1789762814.780391:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:2.0:1789762814.780392:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246490112 00000100:00100000:1.0:1789762814.780403:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1876702246489856:12345-192.168.203.36@tcp:8:touch.0 00010000:00080000:1.0:1789762814.780428:0:7959:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 117 last 0 00000100:00100000:2.0:1789762814.780457:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000020:00000080:1.0:1789762814.780464:0:7959:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b594fd 00002000:00100000:1.0:1789762814.780476:0:7959:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f07ac6c5-9215-4651-bbbc-5b452d5bdd86/ffff9b33f750d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789762814.780476:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246490112:12345-192.168.203.36@tcp:2:touch.0 00002000:00100000:1.0:1789762814.780491:0:7959:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789762814.780567:0:7959:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789762814.780598:0:7959:0:(import.c:65:import_set_state_nolock()) ffff9b33f750e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789762814.780649:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246489856:12345-192.168.203.36@tcp:8:touch.0 Request processed in 246us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762814.780657:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246490112:12345-192.168.203.36@tcp:2:touch.0 Request processed in 187us (308us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789762814.780662:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:2.0:1789762814.780673:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:1.0:1789762814.781298:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.781333:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246489984 00000100:00100000:0.0:1789762814.781338:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246489984 00000100:00100000:0.0:1789762814.781400:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:0.0:1789762814.781417:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:0:x1876702246489984:12345-192.168.203.36@tcp:2:touch.0 00000100:00080000:2.0:1789762814.781420:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789762814.783687:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789762814.783695:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000100:00100000:0.0:1789762814.783836:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:0:x1876702246489984:12345-192.168.203.36@tcp:2:touch.0 Request processed in 2423us (2533us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789762814.783847:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:0.0:1789762814.784648:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.784693:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246490368 00000100:00100000:2.0:1789762814.784699:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246490368 00000100:00100000:2.0:1789762814.784730:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1789762814.784738:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:10330:x1876702246490368:12345-192.168.203.36@tcp:35:touch.0 00000100:00100000:2.0:1789762814.785078:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:10330:x1876702246490368:12345-192.168.203.36@tcp:35:touch.0 Request processed in 341us (431us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789762814.785084:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:3.0:1789762814.801882:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.801937:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246490624 00000100:00100000:1.0:1789762814.801947:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246490624 00000100:00100000:1.0:1789762814.801992:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:1.0:1789762814.802002:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:10334:x1876702246490624:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:1.0:1789762814.802018:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.802030:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59504 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894445e expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802112:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802123:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802130:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802176:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802182:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802186:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762814.802434:0:5926:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00000004:00080000:1.0:1789762814.802438:0:5926:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789762814.802551:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b59519 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802558:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b59519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802563:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b59519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802583:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802593:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802598:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802601:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.802604:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802610:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802618:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:1.0:1789762814.802620:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.802623:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802627:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5950b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762814.802636:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c4e3855 reply state 000000007691ea98 transno 4294967317 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.802642:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762814.802662:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59504 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894445e expref: 28 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802671:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b59519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894445e expref: 27 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.802684:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33d0148900) 00010000:00010000:1.0:1789762814.802686:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762814.802688:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662000, rc 0) 00000100:00100000:1.0:1789762814.802733:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:10334:x1876702246490624:12345-192.168.203.36@tcp:101:touch.0 Request processed in 734us (857us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789762814.802738:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00010000:00010000:2.0:1789762814.803356:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.803364:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.803379:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.803383:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762814.803385:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.803389:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.803396:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x25a23cf0 (ffff9b33d0148700) 00010000:00010000:2.0:1789762814.803398:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762814.803401:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762814.803405:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b59512 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.803976:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.804016:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246490880 00000100:00100000:1.0:1789762814.804023:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246490880 00000100:00100000:1.0:1789762814.804063:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:1.0:1789762814.804073:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:10334:x1876702246490880:12345-192.168.203.36@tcp:36:touch.0 00010000:00010000:1.0:1789762814.804103:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762814.804117:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b59519 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894445e expref: 27 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.804130:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33d0148900) 00010000:00010000:1.0:1789762814.804136:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762814.804155:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.804161:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.804167:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762814.804203:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d89db924 reply state 00000000b13abc91 transno 4294967318 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.804217:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762814.804261:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:10334:x1876702246490880:12345-192.168.203.36@tcp:36:touch.0 Request processed in 191us (286us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789762814.804266:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00010000:00010000:0.0:1789762814.804874:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.804883:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.804888:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.804891:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762814.804893:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.804898:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.804915:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33d0148a00) 00010000:00010000:0.0:1789762814.804917:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762814.804920:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.804934:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59527 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.805037:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.805080:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246491008 00000100:00100000:0.0:1789762814.805085:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246491008 00000100:00100000:0.0:1789762814.805127:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:0.0:1789762814.805134:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:10334:x1876702246491008:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:0.0:1789762814.805144:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762814.805152:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b5952e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944465 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.805178:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b5952e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944465 expref: 28 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.805189:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b5952e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944465 expref: 28 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.805205:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:0.0:1789762814.805209:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789762814.805213:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4642800, rc 0) 00000100:00100000:0.0:1789762814.805248:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:10334:x1876702246491008:12345-192.168.203.36@tcp:101:touch.0 Request processed in 115us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.805254:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1789762814.806030:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.806067:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246491136 00000100:00100000:2.0:1789762814.806073:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246491136 00000100:00100000:2.0:1789762814.806108:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:2.0:1789762814.806115:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246491136:12345-192.168.203.36@tcp:2:touch.0 00000100:00100000:1.0:1789762814.806168:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.806206:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246491264 00000100:00100000:0.0:1789762814.806212:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246491264 00000100:00100000:2.0:1789762814.806221:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2355:x1876702246491136:12345-192.168.203.36@tcp:2:touch.0 Request processed in 105us (191us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789762814.806227:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1789762814.806257:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1789762814.806266:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246491264:12345-192.168.203.36@tcp:2:touch.0 00000100:00100000:0.0:1789762814.806374:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246491264:12345-192.168.203.36@tcp:2:touch.0 Request processed in 110us (208us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789762814.806380:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:1.0:1789762814.807085:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.807126:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246491520 00000100:00100000:0.0:1789762814.807132:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246491520 00000100:00100000:0.0:1789762814.807161:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:0.0:1789762814.807166:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:10334:x1876702246491520:12345-192.168.203.36@tcp:35:touch.0 00000100:00100000:0.0:1789762814.807288:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:10334:x1876702246491520:12345-192.168.203.36@tcp:35:touch.0 Request processed in 121us (205us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789762814.807294:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1789762814.819668:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.819718:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246491776 00000100:00100000:3.0:1789762814.819730:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246491776 00000100:00100000:3.0:1789762814.819808:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:3.0:1789762814.819822:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:10338:x1876702246491776:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1789762814.819865:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762814.819884:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894446c expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.819973:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5953c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.819986:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5953c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.819995:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5953c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762814.820004:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789762814.820097:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894446c expref: 32 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.820111:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5953c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894446c expref: 31 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.820118:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:3.0:1789762814.820120:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789762814.820123:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e3c00, rc 0) 00000100:00100000:3.0:1789762814.820188:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:10338:x1876702246491776:12345-192.168.203.36@tcp:101:bash.0 Request processed in 369us (522us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789762814.820196:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:3.0:1789762814.821025:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.821070:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246491904 00000100:00100000:1.0:1789762814.821078:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246491904 00000100:00100000:1.0:1789762814.821123:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:1.0:1789762814.821134:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:10338:x1876702246491904:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1789762814.821149:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.821161:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5954a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944473 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.821201:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b59551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.821210:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b59551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.821218:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b59551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762814.821244:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789762814.821247:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762814.821270:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b59551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.821288:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5954a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944473 expref: 33 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.821299:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b59551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944473 expref: 32 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.821305:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:1.0:1789762814.821307:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762814.821310:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663000, rc 0) 00000100:00100000:1.0:1789762814.821350:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:10338:x1876702246491904:12345-192.168.203.36@tcp:101:bash.0 Request processed in 219us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762814.821355:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:1.0:1789762814.822682:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.822732:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246492032 00000100:00100000:2.0:1789762814.822737:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246492032 00000100:00100000:2.0:1789762814.822795:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:2.0:1789762814.822804:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:10338:x1876702246492032:12345-192.168.203.36@tcp:37:bash.0 00000100:00100000:2.0:1789762814.824651:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:10338:x1876702246492032:12345-192.168.203.36@tcp:37:bash.0 Request processed in 1848us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762814.824657:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:3.0:1789762814.829831:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.829885:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246492160 00000100:00100000:0.0:1789762814.829898:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246492160 00000100:00100000:0.0:1789762814.829963:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:0.0:1789762814.829993:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:10338:x1876702246492160:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:0.0:1789762814.830014:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762814.830030:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643800/0x5915dfb1c1b59558 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894447a expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830111:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830123:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830131:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830141:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830156:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830160:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830228:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b5956d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830237:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b5956d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830242:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b5956d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762814.830272:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00200000:0.0:1789762814.830276:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762814.830288:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b5956d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830296:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b5956d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830302:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830307:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830311:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830323:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762814.830327:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830332:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830342:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:0.0:1789762814.830344:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762814.830347:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830351:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b5955f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830359:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830363:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830367:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830371:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762814.830372:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830376:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830387:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3950208a (ffff9b33fed74900) 00010000:00010000:0.0:1789762814.830389:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762814.830391:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830394:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642000/0x5915dfb1c1b59566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830417:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643800/0x5915dfb1c1b59558 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894447a expref: 34 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830426:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b5956d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894447a expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.830430:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:0.0:1789762814.830432:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762814.830433:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4643000, rc 0) 00000100:00100000:0.0:1789762814.830481:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:10338:x1876702246492160:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 509us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.830487:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:1.0:1789762814.831911:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.831969:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246492288 00000100:00100000:1.0:1789762814.831976:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.831978:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246492288 00000100:00100000:0.0:1789762814.832053:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246492416 00000100:00100000:1.0:1789762814.832058:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:0.0:1789762814.832060:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246492416 00000100:00100000:1.0:1789762814.832073:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246492288:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1789762814.832083:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.832097:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944481 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.832102:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:2.0:1789762814.832113:0:6911:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789762814.832114:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2355:x1876702246492416:12345-192.168.203.36@tcp:101:chmod.0 00002000:00010000:1.0:1789762814.832121:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x0 00000100:00100000:2.0:1789762814.832125:0:6911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:0.0:1789762814.832126:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.832136:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=117s v=(0 0) 00010000:00010000:1.0:1789762814.832141:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.832146:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944488 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.832162:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 7 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762814.832166:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x0 00010000:00010000:0.0:1789762814.832181:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=117s v=(0 0) 00010000:00010000:1.0:1789762814.832184:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 7 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.832187:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762814.832203:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663e00, rc 0) 00010000:00010000:0.0:1789762814.832207:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 8 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.832229:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 8 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.832240:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4643a00, rc 0) 00000100:00100000:1.0:1789762814.832241:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2356:x1876702246492288:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 173us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762814.832251:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:0.0:1789762814.832274:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246492416:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 161us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.832282:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:1.0:1789762814.833496:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.833561:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246492672 00000100:00100000:3.0:1789762814.833588:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246492672 00000100:00100000:3.0:1789762814.833635:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:3.0:1789762814.833648:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:10338:x1876702246492672:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:3.0:1789762814.833696:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762814.833718:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643000/0x5915dfb1c1b5956d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894447a expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.833734:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:3.0:1789762814.833739:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762814.833805:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.833819:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.833829:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762814.833984:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e5998b1 reply state 0000000049a08af7 transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.833994:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762814.834081:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:10338:x1876702246492672:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 436us (585us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789762814.834090:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00010000:00010000:1.0:1789762814.834609:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.834619:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.834624:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.834628:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.834631:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.834637:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.834646:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:1.0:1789762814.834648:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789762814.834658:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.834663:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59582 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.834900:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.834930:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.834952:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246492800 00000100:00100000:2.0:1789762814.834959:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246492800 00000100:00100000:3.0:1789762814.834976:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246492928 00000100:00100000:3.0:1789762814.834983:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246492928 00000100:00100000:2.0:1789762814.835007:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:3.0:1789762814.835033:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:2.0:1789762814.835041:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fc7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2356:x1876702246492800:12345-192.168.203.36@tcp:2:chmod.0 00000100:00100000:3.0:1789762814.835050:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246492928:12345-192.168.203.36@tcp:2:chmod.0 00002000:00010000:3.0:1789762814.835172:0:6912:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762814.835175:0:6912:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789762815 -> 1789762815 00002000:00010000:3.0:1789762814.835178:0:6912:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789762815 -> 1789762815 00002000:00010000:3.0:1789762814.835180:0:6912:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789762815 -> 1789762815 00002000:00010000:3.0:1789762814.835182:0:6912:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1789762814.835187:0:7959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762814.835190:0:7959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1789762815 -> 1789762815 00002000:00010000:2.0:1789762814.835193:0:7959:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 1789762815 -> 1789762815 00002000:00010000:2.0:1789762814.835196:0:7959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1789762815 -> 1789762815 00002000:00010000:2.0:1789762814.835199:0:7959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789762814.835222:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246492928:12345-192.168.203.36@tcp:2:chmod.0 Request processed in 179us (289us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789762814.835231:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fc7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246492800:12345-192.168.203.36@tcp:2:chmod.0 Request processed in 212us (330us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789762814.835237:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:2.0:1789762814.835254:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1789762814.836211:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.836280:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246493056 00000100:00100000:1.0:1789762814.836287:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246493056 00000100:00100000:1.0:1789762814.836321:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1789762814.836328:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:10338:x1876702246493056:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1789762814.836341:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.836350:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59589 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894448f expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836383:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836392:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836399:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836407:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836412:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836417:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836459:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5959e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836465:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5959e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836470:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5959e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762814.836489:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00000004:00200000:1.0:1789762814.836492:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762814.836501:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5959e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836507:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5959e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836512:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836517:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836521:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836524:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.836526:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836549:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836561:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:1.0:1789762814.836563:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.836566:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836570:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b59590 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836578:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836582:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836586:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836590:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.836592:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836595:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836599:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x25a23cf0 (ffff9b33d0148400) 00010000:00010000:1.0:1789762814.836601:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.836602:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836606:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b59597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836633:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b59589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894448f expref: 35 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836642:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5959e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894448f expref: 34 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.836646:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:1.0:1789762814.836648:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762814.836650:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662000, rc 0) 00000100:00100000:1.0:1789762814.836677:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:10338:x1876702246493056:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 350us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762814.836682:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1789762814.837671:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.837791:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246493184 00000100:00100000:3.0:1789762814.837799:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246493184 00000100:00100000:3.0:1789762814.837859:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:3.0:1789762814.837874:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246493184:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:3.0:1789762814.837885:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789762814.837903:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1789762814.837905:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944496 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762814.837926:0:12136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x0 00000100:00100000:1.0:1789762814.837941:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246493312 00000100:00100000:1.0:1789762814.837950:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246493312 00010000:00010000:3.0:1789762814.837990:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=117s v=(0 0) 00000100:00100000:1.0:1789762814.837998:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00010000:00010000:3.0:1789762814.838001:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789762814.838029:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246493312:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:3.0:1789762814.838029:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 10 pid: 12136 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.838048:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.838062:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894449d expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.838064:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 10 pid: 12136 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762814.838110:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x0 00010000:00010000:3.0:1789762814.838113:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e3000, rc 0) 00010000:00010000:1.0:1789762814.838123:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=117s v=(0 0) 00010000:00010000:1.0:1789762814.838128:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762814.838135:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 9 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.838169:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246493184:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 298us (496us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762814.838172:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 9 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.838191:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00010000:00010000:1.0:1789762814.838201:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7800, rc 0) 00000100:00100000:1.0:1789762814.838240:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2354:x1876702246493312:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 232us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762814.838249:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:1.0:1789762814.839363:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.839400:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246493568 00000100:00100000:0.0:1789762814.839405:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246493568 00000100:00100000:0.0:1789762814.839454:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:0.0:1789762814.839461:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:10338:x1876702246493568:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:0.0:1789762814.839487:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762814.839500:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5959e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894448f expref: 34 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.839510:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:0.0:1789762814.839513:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762814.839548:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.839556:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.839579:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762814.839663:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0f4b49a reply state 000000005ba83fc8 transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.839672:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762814.839726:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:10338:x1876702246493568:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 264us (362us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789762814.839731:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00010000:00010000:1.0:1789762814.840295:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.840303:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.840307:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.840311:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.840313:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.840318:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.840326:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:1.0:1789762814.840327:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789762814.840330:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.840343:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643400/0x5915dfb1c1b595b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.840466:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.840513:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246493696 00000100:00100000:2.0:1789762814.840518:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246493696 00000100:00100000:3.0:1789762814.840562:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.840569:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:2.0:1789762814.840577:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246493696:12345-192.168.203.36@tcp:2:chmod.0 00000100:00100000:0.0:1789762814.840595:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246493824 00000100:00100000:0.0:1789762814.840600:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246493824 00000100:00100000:0.0:1789762814.840631:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:0.0:1789762814.840640:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246493824:12345-192.168.203.36@tcp:2:chmod.0 00002000:00010000:2.0:1789762814.840643:0:7959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762814.840646:0:7959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789762815 -> 1789762815 00002000:00010000:2.0:1789762814.840648:0:7959:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789762815 -> 1789762815 00002000:00010000:2.0:1789762814.840656:0:7959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789762815 -> 1789762815 00002000:00010000:2.0:1789762814.840658:0:7959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789762814.840690:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2353:x1876702246493696:12345-192.168.203.36@tcp:2:chmod.0 Request processed in 114us (228us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789762814.840699:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00002000:00010000:0.0:1789762814.840709:0:6909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789762814.840716:0:6909:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789762815 -> 1789762815 00002000:00010000:0.0:1789762814.840718:0:6909:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789762815 -> 1789762815 00002000:00010000:0.0:1789762814.840720:0:6909:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789762815 -> 1789762815 00002000:00010000:0.0:1789762814.840724:0:6909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789762814.840748:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246493824:12345-192.168.203.36@tcp:2:chmod.0 Request processed in 110us (189us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789762814.840788:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00010000:00010000:1.0:1789762814.843846:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762814.858786:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.858855:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246494080 00000100:00100000:3.0:1789762814.858865:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246494080 00000100:00100000:3.0:1789762814.858913:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:3.0:1789762814.858925:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:10342:x1876702246494080:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762814.858951:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762814.858953:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762814.858969:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b59551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944473 expref: 34 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.858983:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:3.0:1789762814.858986:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762814.858994:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b595ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444a4 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859110:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859121:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859128:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859138:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859151:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859157:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859194:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b595cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859200:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b595cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859205:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b595cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762814.859211:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:3.0:1789762814.859256:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859261:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859266:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859270:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762814.859274:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859278:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859293:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:3.0:1789762814.859295:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762814.859298:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859303:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b595c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859310:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859313:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859317:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859321:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762814.859323:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859327:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859331:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3950208a (ffff9b33e2f49f00) 00010000:00010000:3.0:1789762814.859332:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762814.859334:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859337:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b595c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859387:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b595ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444a4 expref: 36 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859396:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b595cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444a4 expref: 35 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.859402:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:3.0:1789762814.859403:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762814.859405:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2400, rc 0) 00000100:00100000:3.0:1789762814.859447:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:10342:x1876702246494080:12345-192.168.203.36@tcp:101:dd.500 Request processed in 527us (665us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789762814.859452:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:3.0:1789762814.860657:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.860703:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246494208 00000100:00100000:1.0:1789762814.860710:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246494208 00000100:00100000:1.0:1789762814.860747:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:1.0:1789762814.860780:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:10342:x1876702246494208:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:1.0:1789762814.860795:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.860805:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b595dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444ab expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.860824:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7a00/0x5915dfb1c1b595e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.860833:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7a00/0x5915dfb1c1b595e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.860840:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7a00/0x5915dfb1c1b595e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.860922:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b595dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ab expref: 37 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.860950:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7a00/0x5915dfb1c1b595e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ab expref: 36 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.860956:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:1.0:1789762814.860964:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789762814.860967:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7a00, rc 0) 00000100:00100000:1.0:1789762814.861016:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:10342:x1876702246494208:12345-192.168.203.36@tcp:101:dd.500 Request processed in 224us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762814.861023:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:0.0:1789762814.861950:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.862019:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246494464 00000100:00100000:3.0:1789762814.862027:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246494464 00000100:00100000:3.0:1789762814.862083:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:3.0:1789762814.862096:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:10342:x1876702246494464:12345-192.168.203.36@tcp:36:dd.500 00010000:00010000:3.0:1789762814.862127:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762814.862143:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b595cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444a4 expref: 36 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.862158:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:3.0:1789762814.862162:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762814.862264:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.862276:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.862293:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762814.862338:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000004:00010000:3.0:1789762814.862373:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4509995 reply state 00000000e8876554 transno 4294967325 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.862382:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762814.862449:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:10342:x1876702246494464:12345-192.168.203.36@tcp:36:dd.500 Request processed in 356us (500us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789762814.862458:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000020:00080000:3.0:1789762814.862464:0:5924:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789762814.863181:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863193:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863201:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863208:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762814.863212:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863220:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863232:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:1.0:1789762814.863235:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762814.863239:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863247:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b595eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.863444:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.863480:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246494592 00000100:00100000:1.0:1789762814.863486:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246494592 00000100:00100000:1.0:1789762814.863521:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:1.0:1789762814.863552:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:10342:x1876702246494592:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:1.0:1789762814.863564:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762814.863591:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0ee6a0b/0x5915dfb1c1b595f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444b2 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863614:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 11 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863626:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762814.863630:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762814.863637:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ee6a0b/0x5915dfb1c1b595f2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b2 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863670:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 11 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.863704:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 11 pid: 6912 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762814.863725:0:6911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f749e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254896128:192.168.203.36@tcp:104: 00000100:00100000:1.0:1789762814.863839:0:6911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f47b8300 going to sleep for 11 seconds 00000100:00100000:1.0:1789762814.864671:0:6911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f749e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254896128:192.168.203.36@tcp:104: 00010000:00010000:1.0:1789762814.864717:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0ee6a0b/0x5915dfb1c1b595f2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b2 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762814.864756:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f6000, rc 0) 00000100:00100000:1.0:1789762814.864839:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:10342:x1876702246494592:12345-192.168.203.36@tcp:101:dd.500 Request processed in 1289us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.864852:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762814.864856:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:3.0:1789762814.864965:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246494720 00000100:00100000:3.0:1789762814.865008:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246494720 00010000:00010000:3.0:1789762814.865037:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 11 pid: 6912 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.865072:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:3.0:1789762814.865083:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2354:x1876702246494720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762814.865095:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762814.865101:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 11 pid: 6912 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.865115:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 11 pid: 6912 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.865135:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59574 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944481 expref: 11 pid: 6912 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.865157:0:5954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762814.865162:0:5954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762814.865168:0:5954:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0ee6a0b/0x5915dfb1c1b595f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b2 expref: 10 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.865179:0:5954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ee6a0b/0x5915dfb1c1b595f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b2 expref: 10 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.865213:0:5954:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b0ee6a0b/0x5915dfb1c1b595f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b2 expref: 10 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.865228:0:5954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f746ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5954:1876702254896256:192.168.203.36@tcp:105: 00000100:00100000:3.0:1789762814.865291:0:5954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c8e6f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789762814.866084:0:5954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f746ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5954:1876702254896256:192.168.203.36@tcp:105: 00010000:00010000:3.0:1789762814.866100:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762814.866190:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246494720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1107us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762814.866200:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:1.0:1789762814.866281:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.866349:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246494848 00000100:00100000:3.0:1789762814.866355:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246494848 00000100:00100000:3.0:1789762814.866401:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:3.0:1789762814.866411:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:10342:x1876702246494848:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762814.866422:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762814.866442:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075b87727/0x5915dfb1c1b595f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444b9 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.866466:0:12136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 12 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.866476:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762814.866480:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762814.866484:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075b87727/0x5915dfb1c1b595f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b9 expref: 12 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.866518:0:12136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 12 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.866547:0:12136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 12 pid: 6909 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762814.866560:0:12136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f746ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12136:1876702254896384:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762814.866609:0:12136:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c8e6f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789762814.867404:0:12136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f746ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12136:1876702254896384:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762814.867432:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075b87727/0x5915dfb1c1b595f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b9 expref: 12 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762814.867507:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2e00, rc 0) 00000100:00100000:3.0:1789762814.867566:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:10342:x1876702246494848:12345-192.168.203.36@tcp:101:dd.500 Request processed in 1155us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762814.867594:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:1.0:1789762814.867647:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.867711:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246494976 00000100:00100000:0.0:1789762814.867717:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246494976 00010000:00010000:0.0:1789762814.867737:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 12 pid: 6909 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.867802:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:0.0:1789762814.867810:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246494976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762814.867821:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762814.867825:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 12 pid: 6909 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.867836:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 12 pid: 6909 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.867850:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5957b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944488 expref: 12 pid: 6909 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.867860:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.867863:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762814.867867:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075b87727/0x5915dfb1c1b595f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b9 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.867873:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075b87727/0x5915dfb1c1b595f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b9 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762814.867909:0:5909:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000075b87727/0x5915dfb1c1b595f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b9 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762814.867922:0:5909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f764b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254896512:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762814.867967:0:5909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e0c883c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762814.868868:0:5909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f764b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254896512:192.168.203.36@tcp:105: 00010000:00010000:0.0:1789762814.868883:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762814.868918:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2353:x1876702246494976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1107us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762814.868928:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:2.0:1789762814.868980:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.869028:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246495104 00000100:00100000:0.0:1789762814.869034:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246495104 00002000:00010000:0.0:1789762814.869055:0:6915:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:0.0:1789762814.869061:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e4a80 with x1876702246495104 ext(0->18446744073709551615) 00002000:00010000:0.0:1789762814.869069:0:6915:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f75e4a80. 00000100:00100000:0.0:1789762814.869088:0:6915:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 3 deadline 0 time 117306331465 state 0x0 ref 1 00000100:00100000:0.0:1789762814.869096:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 3 deadline 117506331465 time 117306331465 state 0x1 ref 1 00000100:00100000:0.0:1789762814.869117:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 2 deadline 117506331465 time 117306364044 state 0x0 ref 1 00000100:00100000:0.0:1789762814.869126:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246495104:12345-192.168.203.36@tcp:10:dd.500 00000100:00100000:3.0:1789762814.869149:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.869199:0:6917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789762814.869206:0:6917:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00002000:00010000:0.0:1789762814.869300:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789762814.869303:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1789762815 -> 1789762815 00002000:00010000:0.0:1789762814.869311:0:6915:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 1789762815 -> 1789762815 00002000:00010000:0.0:1789762814.869313:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1789762815 -> 1789762815 00002000:00010000:0.0:1789762814.869315:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789762814.869348:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2356:x1876702246495104:12345-192.168.203.36@tcp:10:dd.500 Request processed in 222us (370us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789762814.869355:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1789762814.869359:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 2 deadline 117506331465 time 117306364044 state 0x2 ref 0 00002000:00010000:0.0:1789762814.869364:0:6915:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:0.0:1789762814.869367:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e4a80 with x1876702246495104 ext(0->18446744073709551615) 00002000:00010000:0.0:1789762814.869372:0:6915:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f75e4a80. 00000100:00100000:3.0:1789762814.869386:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246495232 00000100:00100000:3.0:1789762814.869395:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246495232 00002000:00010000:3.0:1789762814.869425:0:6917:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789762814.869430:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f746ad80 with x1876702246495232 ext(0->18446744073709551615) 00002000:00010000:3.0:1789762814.869438:0:6917:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f746ad80. 00000100:00100000:3.0:1789762814.869450:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 2 deadline 117506331465 time 117306364044 state 0x0 ref 1 00000100:00100000:3.0:1789762814.869510:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 2 deadline 117506364044 time 117306364044 state 0x1 ref 1 00000100:00100000:3.0:1789762814.869566:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 117506364044 time 117306810471 state 0x0 ref 1 00000100:00100000:3.0:1789762814.869595:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2355:x1876702246495232:12345-192.168.203.36@tcp:10:dd.500 00000100:00100000:1.0:1789762814.869597:0:6916:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00002000:00010000:3.0:1789762814.869887:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762814.869892:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789762815 -> 1789762815 00002000:00010000:3.0:1789762814.869895:0:6917:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789762815 -> 1789762815 00002000:00010000:3.0:1789762814.869898:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789762815 -> 1789762815 00002000:00010000:3.0:1789762814.869901:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789762814.869947:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2355:x1876702246495232:12345-192.168.203.36@tcp:10:dd.500 Request processed in 368us (800us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789762814.869957:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:3.0:1789762814.869963:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 117506364044 time 117306810471 state 0x2 ref 0 00002000:00010000:3.0:1789762814.869969:0:6917:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789762814.869973:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f746ad80 with x1876702246495232 ext(0->18446744073709551615) 00002000:00010000:3.0:1789762814.869986:0:6917:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f746ad80. 00000100:00100000:3.0:1789762814.907921:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762814.908018:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246495360 00000100:00100000:0.0:1789762814.908032:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246495360 00002000:00100000:0.0:1789762814.908090:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->4194303) req@ffff9b33f7468700 x1876702246495360/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:595/0 lens 488/0 e 0 to 0 dl 1789762825 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762814.908103:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7468700 with x1876702246495360 ext(0->4194303) 00002000:00010000:0.0:1789762814.908108:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7468700 00000100:00100000:0.0:1789762814.908119:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 117506364044 time 117306810471 state 0x0 ref 1 00000100:00100000:0.0:1789762814.908128:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 117506810471 time 117306810471 state 0x1 ref 1 00000100:00100000:0.0:1789762814.908153:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117506810471 time 117345399198 state 0x0 ref 1 00000100:00100000:0.0:1789762814.908162:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2355:x1876702246495360:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:0.0:1789762814.927326:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246495360:12345-192.168.203.36@tcp:4:dd.500 Request processed in 19154us (19406us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789762814.927342:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:0.0:1789762814.927360:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117506810471 time 117345399198 state 0x2 ref 0 00002000:00100000:0.0:1789762814.927377:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->4194303) req@ffff9b33f7468700 x1876702246495360/t4294967304(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:595/0 lens 488/448 e 0 to 0 dl 1789762825 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762814.927389:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7468700 with x1876702246495360 ext(0->4194303) 00002000:00010000:0.0:1789762814.927396:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7468700 00000100:00100000:3.0:1789762814.951484:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762814.951581:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246495488 00000100:00100000:2.0:1789762814.951596:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246495488 00002000:00100000:2.0:1789762814.951651:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->4194303) req@ffff9b33f7469f80 x1876702246495488/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:595/0 lens 488/0 e 0 to 0 dl 1789762825 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762814.951663:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7469f80 with x1876702246495488 ext(0->4194303) 00002000:00010000:2.0:1789762814.951669:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f7469f80 00000100:00100000:2.0:1789762814.951683:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117506810471 time 117345399198 state 0x0 ref 1 00000100:00100000:2.0:1789762814.951695:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117545399198 time 117345399198 state 0x1 ref 1 00000100:00100000:1.0:1789762814.991124:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762814.991169:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246495616 00000100:00100000:3.0:1789762814.991193:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246495616 00002000:00100000:3.0:1789762814.991256:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (4194304->8388607) req@ffff9b33f749e680 x1876702246495616/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:595/0 lens 488/0 e 0 to 0 dl 1789762825 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762814.991269:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749e680 with x1876702246495616 ext(4194304->8388607) 00002000:00010000:3.0:1789762814.991276:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f749e680 00000100:00100000:3.0:1789762814.991297:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117545399198 time 117345399198 state 0x1 ref 2 00000100:00100000:2.0:1789762815.024975:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.025045:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246495744 00000100:00100000:3.0:1789762815.025060:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246495744 00000100:00080000:2.0:1789762815.025111:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1789762815.025119:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (4194304->8364031) req@ffff9b33f75e7800 x1876702246495744/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762815.025130:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e7800 with x1876702246495744 ext(4194304->8364031) 00002000:00010000:3.0:1789762815.025135:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f75e7800 00000100:00100000:3.0:1789762815.025149:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117545399198 time 117345399198 state 0x1 ref 3 00000100:00100000:3.0:1789762815.108275:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117745509902 time 117545509902 state 0x1 ref 3 00000100:00100000:3.0:1789762815.108315:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2356:x1876702246495488:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:3.0:1789762815.124705:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2356:x1876702246495488:12345-192.168.203.36@tcp:4:dd.500 Request processed in 16398us (173226us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789762815.124716:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 3 00002000:00100000:3.0:1789762815.124729:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->4194303) req@ffff9b33f7469f80 x1876702246495488/t4294967305(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:595/0 lens 488/448 e 0 to 0 dl 1789762825 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762815.124743:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7469f80 with x1876702246495488 ext(0->4194303) 00002000:00010000:3.0:1789762815.124748:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f7469f80 00000100:00100000:0.0:1789762815.126570:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.126621:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246496000 00000100:00100000:2.0:1789762815.126628:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246496000 00000100:00100000:2.0:1789762815.126674:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00080000:0.0:1789762815.126679:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762815.126685:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:10342:x1876702246496000:12345-192.168.203.36@tcp:35:dd.500 00000100:00100000:2.0:1789762815.126888:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:10342:x1876702246496000:12345-192.168.203.36@tcp:35:dd.500 Request processed in 205us (320us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789762815.126897:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:1.0:1789762815.154598:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762815.154677:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246496128 00000100:00100000:0.0:1789762815.154690:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246496128 00002000:00100000:0.0:1789762815.154737:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (8364032->8388607) req@ffff9b33f749fb80 x1876702246496128/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762815.154747:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749fb80 with x1876702246496128 ext(8364032->8388607) 00002000:00010000:0.0:1789762815.154772:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f749fb80 00000100:00100000:0.0:1789762815.154786:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117745509902 time 117545509902 state 0x1 ref 3 00000100:00100000:0.0:1789762815.158170:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.158204:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246496384 00000100:00100000:3.0:1789762815.158210:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246496384 00000100:00100000:3.0:1789762815.158247:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:3.0:1789762815.158254:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:10354:x1876702246496384:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762815.158271:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762815.158287:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59600 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444c0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158393:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158404:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158412:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158421:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158427:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158431:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158480:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158498:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158504:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762815.158512:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00010000:00010000:3.0:1789762815.158601:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158611:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158619:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158625:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762815.158629:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158634:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158644:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:3.0:1789762815.158646:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762815.158649:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158654:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158663:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158673:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158678:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158681:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762815.158683:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158687:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158691:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x25a23cf0 (ffff9b33e2f49300) 00010000:00010000:3.0:1789762815.158693:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762815.158695:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158698:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5960e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158744:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59600 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c0 expref: 41 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158782:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c0 expref: 40 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.158791:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:3.0:1789762815.158794:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762815.158802:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2600, rc 0) 00000100:00100000:3.0:1789762815.158852:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:10354:x1876702246496384:12345-192.168.203.36@tcp:101:dd.0 Request processed in 597us (695us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789762815.158858:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:1.0:1789762815.164033:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762815.164098:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246496512 00000100:00100000:0.0:1789762815.164105:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246496512 00000100:00100000:0.0:1789762815.164151:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:0.0:1789762815.164165:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10354:x1876702246496512:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762815.164187:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762815.164198:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59623 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444c7 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.164220:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 17 pid: 12136 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.164238:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.164242:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762815.164246:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59623 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c7 expref: 17 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.164273:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 17 pid: 12136 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.164284:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 17 pid: 12136 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.164298:0:6909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f764bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1876702254896640:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762815.164381:0:6909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e0c88f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789762815.164540:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.164596:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246496640 00000100:00100000:1.0:1789762815.164606:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246496640 00000100:00100000:1.0:1789762815.164655:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:1.0:1789762815.164663:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:10356:x1876702246496640:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762815.164678:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762815.164693:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aae74722/0x5915dfb1c1b5962a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444ce expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.164717:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762815.164721:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762815.164726:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aae74722/0x5915dfb1c1b5962a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ce expref: 19 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.164736:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aae74722/0x5915dfb1c1b5962a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ce expref: 19 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.164790:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7400, rc 0) 00000100:00100000:1.0:1789762815.164838:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:10356:x1876702246496640:12345-192.168.203.36@tcp:101:dd.0 Request processed in 177us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762815.164844:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:3.0:1789762815.165054:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.165099:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246496768 00000100:00100000:1.0:1789762815.165104:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246496768 00000100:00100000:1.0:1789762815.165138:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:1.0:1789762815.165145:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:10355:x1876702246496768:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762815.165151:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762815.165159:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59631 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444d5 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.165161:0:6909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f764bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1876702254896640:192.168.203.36@tcp:104: 00010000:00010000:1.0:1789762815.165190:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762815.165193:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762815.165198:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59631 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444d5 expref: 20 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.165211:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59631 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444d5 expref: 20 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.165216:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59623 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c7 expref: 20 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.165232:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7000, rc 0) 00010000:00010000:0.0:1789762815.165242:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4643a00, rc 0) 00000100:00100000:1.0:1789762815.165269:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:10355:x1876702246496768:12345-192.168.203.36@tcp:101:dd.0 Request processed in 124us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762815.165277:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:10354:x1876702246496512:12345-192.168.203.36@tcp:101:dd.0 Request processed in 1114us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762815.165287:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:0.0:1789762815.165302:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:0.0:1789762815.165834:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.165886:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246496896 00000100:00100000:2.0:1789762815.165891:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246496896 00010000:00010000:2.0:1789762815.165911:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 19 pid: 12136 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762815.165935:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:2.0:1789762815.165941:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2355:x1876702246496896:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762815.165949:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762815.165961:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 19 pid: 12136 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.165970:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 19 pid: 12136 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.165987:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ca2986d/0x5915dfb1c1b595a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944496 expref: 19 pid: 12136 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.166000:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.166004:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.166011:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c7 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.166018:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59623 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c7 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.166024:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.166031:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.166036:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aae74722/0x5915dfb1c1b5962a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ce expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.166050:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aae74722/0x5915dfb1c1b5962a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ce expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.166056:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.166058:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.166061:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444d5 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.166067:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444d5 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.166084:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444d5 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762815.166092:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f75e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1876702254896768:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762815.166138:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aae74722/0x5915dfb1c1b5962a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ce expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762815.166149:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f75e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1876702254896896:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762815.166183:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59623 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c7 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762815.166207:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f75e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1876702254897024:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762815.166240:0:5910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37000 going to sleep for 11 seconds 00000100:00100000:2.0:1789762815.167421:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f75e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1876702254896768:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762815.167429:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f75e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1876702254896896:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762815.167435:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f75e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1876702254897024:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762815.167448:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762815.167479:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:2355:x1876702246496896:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1538us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762815.167487:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:3.0:1789762815.167567:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.167633:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246497024 00000100:00100000:1.0:1789762815.167640:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246497024 00000100:00100000:1.0:1789762815.167680:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:1.0:1789762815.167690:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:10354:x1876702246497024:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762815.167705:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762815.167718:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59638 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444dc expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.167746:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5963f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.167780:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.167790:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.167890:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444dc expref: 42 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.167905:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5963f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444dc expref: 41 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.167912:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:1.0:1789762815.167915:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789762815.167916:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663e00, rc 0) 00000100:00100000:1.0:1789762815.167949:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10354:x1876702246497024:12345-192.168.203.36@tcp:101:dd.0 Request processed in 263us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762815.167954:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:0.0:1789762815.175329:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.175420:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246497152 00000100:00100000:2.0:1789762815.175429:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246497152 00000100:00100000:2.0:1789762815.175472:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1789762815.175482:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10358:x1876702246497152:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762815.175495:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762815.175510:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59646 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444e3 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.175550:0:7959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 15 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.175558:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.175561:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.175565:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59646 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444e3 expref: 15 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.175602:0:7959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 15 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.175616:0:7959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 15 pid: 6911 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762815.175629:0:7959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f75e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7959:1876702254897152:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762815.175693:0:7959:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762815.176602:0:7959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f75e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7959:1876702254897152:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762815.176619:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59646 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444e3 expref: 15 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.176631:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460000, rc 0) 00000100:00100000:2.0:1789762815.176661:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:10358:x1876702246497152:12345-192.168.203.36@tcp:101:dd.0 Request processed in 1181us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762815.176667:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1789762815.176827:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.176867:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246497280 00000100:00100000:2.0:1789762815.176871:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246497280 00010000:00010000:2.0:1789762815.176886:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 15 pid: 6911 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762815.176908:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:2.0:1789762815.176913:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2356:x1876702246497280:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762815.176929:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762815.176942:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 15 pid: 6911 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.176952:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 15 pid: 6911 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.176971:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b595ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894449d expref: 15 pid: 6911 timeout: 217 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.176988:0:5954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.176991:0:5954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.177000:0:5954:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444e3 expref: 14 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.177010:0:5954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444e3 expref: 14 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.177034:0:5954:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444e3 expref: 14 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762815.177046:0:5954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f75e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5954:1876702254897280:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762815.177082:0:5954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762815.177837:0:5954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f75e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5954:1876702254897280:192.168.203.36@tcp:105: 00010000:00010000:3.0:1789762815.177846:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762815.177872:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2356:x1876702246497280:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 958us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762815.177879:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:2.0:1789762815.308412:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 117945649997 time 117745649997 state 0x1 ref 3 00000100:00100000:2.0:1789762815.308447:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246495616:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:1.0:1789762815.308868:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.308936:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246497408 00000100:00100000:3.0:1789762815.308950:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246497408 00002000:00100000:3.0:1789762815.309006:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->4194303) req@ffff9b33f749ea00 x1876702246497408/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762815.309017:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749ea00 with x1876702246497408 ext(0->4194303) 00002000:00010000:3.0:1789762815.309023:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f749ea00 00000100:00100000:3.0:1789762815.309043:0:6916:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 3 deadline 0 time 117746288139 state 0x0 ref 1 00000100:00100000:3.0:1789762815.309055:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 3 deadline 117746388139 time 117746288139 state 0x1 ref 1 00000100:00100000:3.0:1789762815.309085:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117746388139 time 117746330992 state 0x0 ref 1 00000100:00100000:3.0:1789762815.309098:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246497408:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762815.310725:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.310791:0:6917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789762815.310803:0:6917:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789762815.310971:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246497536 00000100:00100000:0.0:1789762815.310980:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246497536 00002000:00100000:0.0:1789762815.311027:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (4194304->8388607) req@ffff9b33f7648380 x1876702246497536/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762815.311040:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7648380 with x1876702246497536 ext(4194304->8388607) 00002000:00010000:0.0:1789762815.311047:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7648380 00000100:00100000:0.0:1789762815.311061:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117746430992 time 117746330992 state 0x1 ref 2 00000100:00100000:1.0:1789762815.313116:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117746430992 time 117750360719 state 0x0 ref 2 00000100:00100000:1.0:1789762815.313129:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2354:x1876702246497536:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762815.314013:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762815.314041:0:6917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1789762815.314049:0:6917:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1789762815.314115:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246497664 00000100:00100000:0.0:1789762815.314119:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246497664 00002000:00100000:0.0:1789762815.314147:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (4194304->8388607) req@ffff9b33f7649880 x1876702246497664/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762815.314159:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7649880 with x1876702246497664 ext(4194304->8388607) 00002000:00010000:0.0:1789762815.314164:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f7649880 00000100:00100000:0.0:1789762815.314175:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117750460719 time 117750360719 state 0x1 ref 3 00000100:00100000:0.0:1789762815.314955:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117750460719 time 117752199451 state 0x0 ref 3 00000100:00100000:0.0:1789762815.314970:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:2353:x1876702246497664:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:1.0:1789762815.316203:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.316233:0:6917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1789762815.316242:0:6917:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:3.0:1789762815.319934:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246497792 00000100:00100000:3.0:1789762815.319941:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246497792 00002000:00100000:3.0:1789762815.319973:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4194303) req@ffff9b33f749c000 x1876702246497792/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762815.319981:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749c000 with x1876702246497792 ext(0->4194303) 00002000:00010000:3.0:1789762815.319996:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f749c000 00000100:00100000:3.0:1789762815.320006:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117752299451 time 117752199451 state 0x1 ref 4 00000100:00100000:3.0:1789762815.322276:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117752299451 time 117759520166 state 0x0 ref 4 00000100:00100000:3.0:1789762815.322297:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2354:x1876702246497792:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:1.0:1789762815.331521:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2353:x1876702246497408:12345-192.168.203.36@tcp:4:dd.0 Request processed in 22418us (22646us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789762815.331546:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 7 00002000:00100000:1.0:1789762815.331559:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->4194303) req@ffff9b33f749ea00 x1876702246497408/t4294967305(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762815.331568:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749ea00 with x1876702246497408 ext(0->4194303) 00002000:00010000:1.0:1789762815.331574:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f749ea00 00000100:00100000:1.0:1789762815.339949:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2355:x1876702246495616:12345-192.168.203.36@tcp:4:dd.500 Request processed in 31511us (348828us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789762815.339965:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 4 00002000:00100000:1.0:1789762815.339981:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2:0x0] (4194304->8388607) req@ffff9b33f749e680 x1876702246495616/t4294967306(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:595/0 lens 488/448 e 0 to 0 dl 1789762825 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762815.339994:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749e680 with x1876702246495616 ext(4194304->8388607) 00002000:00010000:1.0:1789762815.340002:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f749e680 00000100:00100000:1.0:1789762815.345877:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2353:x1876702246497664:12345-192.168.203.36@tcp:4:dd.0 Request processed in 30899us (31856us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789762815.345894:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 9 00002000:00100000:1.0:1789762815.345917:0:12139:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x4:0x0] (4194304->8388607) req@ffff9b33f7649880 x1876702246497664/t4294967306(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762815.345927:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7649880 with x1876702246497664 ext(4194304->8388607) 00002000:00010000:1.0:1789762815.345933:0:12139:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f7649880 00000100:00100000:2.0:1789762815.350027:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.350069:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246498048 00000100:00100000:3.0:1789762815.350079:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246498048 00000100:00100000:2.0:1789762815.350151:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1789762815.350166:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10355:x1876702246498048:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762815.350392:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10355:x1876702246498048:12345-192.168.203.36@tcp:35:dd.0 Request processed in 231us (372us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789762815.350399:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:0.0:1789762815.351938:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2354:x1876702246497536:12345-192.168.203.36@tcp:4:dd.0 Request processed in 38808us (41213us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789762815.351948:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 8 00002000:00100000:0.0:1789762815.351963:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3:0x0] (4194304->8388607) req@ffff9b33f7648380 x1876702246497536/t4294967307(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762815.351983:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7648380 with x1876702246497536 ext(4194304->8388607) 00002000:00010000:0.0:1789762815.351988:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7648380 00000100:00100000:0.0:1789762815.360550:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2354:x1876702246497792:12345-192.168.203.36@tcp:4:dd.0 Request processed in 38251us (44338us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789762815.360563:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:0.0:1789762815.360570:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117752299451 time 117759520166 state 0x2 ref 0 00002000:00100000:0.0:1789762815.360584:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x4:0x0] (0->4194303) req@ffff9b33f749c000 x1876702246497792/t4294967307(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762815.360593:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749c000 with x1876702246497792 ext(0->4194303) 00002000:00010000:0.0:1789762815.360605:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f749c000 00000100:00100000:0.0:1789762815.508500:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118145738235 time 117945738235 state 0x1 ref 2 00000100:00100000:0.0:1789762815.508539:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2356:x1876702246495744:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:0.0:1789762815.522265:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:2356:x1876702246495744:12345-192.168.203.36@tcp:4:dd.500 Request processed in 13746us (497294us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789762815.522275:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 5 00002000:00100000:0.0:1789762815.522285:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (4194304->8364031) req@ffff9b33f75e7800 x1876702246495744/t4294967308(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762815.522294:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e7800 with x1876702246495744 ext(4194304->8364031) 00002000:00010000:0.0:1789762815.522300:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f75e7800 00000100:00100000:3.0:1789762815.708691:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118145738235 time 118145925220 state 0x0 ref 1 00000100:00100000:3.0:1789762815.708729:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2354:x1876702246496128:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:3.0:1789762815.710730:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:2354:x1876702246496128:12345-192.168.203.36@tcp:4:dd.500 Request processed in 2013us (556139us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789762815.710742:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:3.0:1789762815.710749:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118145738235 time 118145925220 state 0x2 ref 0 00002000:00100000:3.0:1789762815.710802:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (8364032->8388607) req@ffff9b33f749fb80 x1876702246496128/t4294967309(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762815.710812:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749fb80 with x1876702246496128 ext(8364032->8388607) 00002000:00010000:3.0:1789762815.710818:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f749fb80 00000100:00100000:2.0:1789762815.734822:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.734856:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.734885:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246498176 00000100:00100000:1.0:1789762815.734896:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246498176 00000100:00100000:3.0:1789762815.734911:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246498304 00000100:00100000:3.0:1789762815.734917:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246498304 00002000:00100000:3.0:1789762815.734945:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (1949696->2097151) req@ffff9b33f75e5c00 x1876702246498304/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762815.734946:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (1982464->5242879) req@ffff9b33f75e7480 x1876702246498176/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762815.734968:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e7480 with x1876702246498176 ext(1982464->5242879) 00002000:00010000:1.0:1789762815.734977:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f75e7480 00002000:00100000:3.0:1789762815.734978:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e5c00 with x1876702246498304 ext(1949696->2097151) 00002000:00010000:3.0:1789762815.734986:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f75e5c00 00000100:00100000:1.0:1789762815.734994:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117752299451 time 117759520166 state 0x0 ref 1 00000100:00100000:3.0:1789762815.735001:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117759620166 time 117759520166 state 0x1 ref 2 00000100:00100000:1.0:1789762815.735017:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 117759620166 time 117759520166 state 0x1 ref 2 00000100:00100000:3.0:1789762815.735032:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 118172376796 time 118172276796 state 0x1 ref 2 00000100:00100000:1.0:1789762815.735046:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 1 deadline 118172376796 time 118172290564 state 0x0 ref 2 00000100:00100000:3.0:1789762815.735047:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:2353:x1876702246498304:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:1.0:1789762815.735065:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2356:x1876702246498176:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:1.0:1789762815.737148:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2356:x1876702246498176:12345-192.168.203.36@tcp:4:dd.0 Request processed in 2082us (2329us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789762815.737161:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 12 00002000:00100000:1.0:1789762815.737172:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (1982464->5242879) req@ffff9b33f75e7480 x1876702246498176/t4294967308(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 504/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762815.737184:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e7480 with x1876702246498176 ext(1982464->5242879) 00002000:00010000:1.0:1789762815.737189:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f75e7480 00000100:00100000:0.0:1789762815.737350:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2353:x1876702246498304:12345-192.168.203.36@tcp:4:dd.0 Request processed in 2305us (2489us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789762815.737375:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:0.0:1789762815.737381:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 1 deadline 118172376796 time 118172290564 state 0x2 ref 0 00002000:00100000:0.0:1789762815.737394:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (1949696->2097151) req@ffff9b33f75e5c00 x1876702246498304/t4294967310(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/448 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762815.737402:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f75e5c00 with x1876702246498304 ext(1949696->2097151) 00002000:00010000:0.0:1789762815.737408:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f75e5c00 00000100:00100000:3.0:1789762815.750972:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.751033:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762815.751059:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246498432 00000100:00100000:0.0:1789762815.751069:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246498432 00000100:00100000:0.0:1789762815.751121:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246498560 00000100:00100000:0.0:1789762815.751124:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246498560 00000100:00100000:1.0:1789762815.751131:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:1.0:1789762815.751154:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:5888:x1876702246498432:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762815.751169:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1789762815.751172:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:0.0:1789762815.751188:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:5430:x1876702246498560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1789762815.751189:0:7992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762815.751204:0:7992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:0.0:1789762815.751211:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00002000:00010000:0.0:1789762815.751224:0:5909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789762815.751230:0:5909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:1.0:1789762815.751231:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0ee6a0b/0x5915dfb1c1b595f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b2 expref: 21 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.751258:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b87727/0x5915dfb1c1b595f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444b9 expref: 26 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762815.751273:0:7992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762815.751277:0:7992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 16384 00002000:00010000:0.0:1789762815.751291:0:5909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 8388608 00010000:00010000:1.0:1789762815.751293:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59646 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444e3 expref: 20 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762815.751297:0:5909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:0.0:1789762815.751318:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59631 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444d5 expref: 25 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.751321:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762815.751340:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59623 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c7 expref: 24 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762815.751363:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:5888:x1876702246498432:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 212us (395us total) trans 0 rc 0/0 00010000:00010000:0.0:1789762815.751367:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aae74722/0x5915dfb1c1b5962a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ce expref: 23 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762815.751381:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00010000:00010000:0.0:1789762815.751401:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762815.751434:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:5430:x1876702246498560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 251us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762815.751441:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:2.0:1789762815.781025:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.781081:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246498816 00000100:00100000:3.0:1789762815.781090:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246498816 00000100:00100000:3.0:1789762815.781137:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:3.0:1789762815.781146:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10390:x1876702246498816:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762815.781167:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762815.781193:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b5964d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444ea expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781271:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781282:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781293:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781303:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781320:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781325:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781412:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781419:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781424:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762815.781431:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 16777216 00010000:00010000:3.0:1789762815.781486:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781491:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781496:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781500:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762815.781503:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781508:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781552:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:3.0:1789762815.781555:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762815.781558:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781563:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b59654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781574:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781578:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781583:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781586:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762815.781588:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781592:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781596:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3950208a (ffff9b33e2f49600) 00010000:00010000:3.0:1789762815.781597:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762815.781599:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781602:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5965b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781641:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b5964d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ea expref: 45 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781651:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ea expref: 44 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.781657:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:3.0:1789762815.781659:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762815.781660:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e3a00, rc 0) 00000100:00100000:3.0:1789762815.781703:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+44:10390:x1876702246498816:12345-192.168.203.36@tcp:101:dd.0 Request processed in 559us (685us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789762815.781708:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:2.0:1789762815.783089:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.783111:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.783139:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246498944 00000100:00100000:1.0:1789762815.783143:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246499200 00000100:00100000:3.0:1789762815.783145:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246498944 00000100:00100000:2.0:1789762815.783146:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.783150:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246499200 00000100:00100000:3.0:1789762815.783196:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246499072 00000100:00100000:3.0:1789762815.783201:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246499072 00000100:00100000:1.0:1789762815.783214:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:1.0:1789762815.783231:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:10391:x1876702246498944:12345-192.168.203.36@tcp:101:dd.0 00000100:00100000:2.0:1789762815.783231:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:3.0:1789762815.783243:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00010000:00010000:1.0:1789762815.783244:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789762815.783249:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:10390:x1876702246499200:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762815.783259:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444f1 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762815.783260:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:10392:x1876702246499072:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762815.783263:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762815.783276:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762815.783279:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444ff expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762815.783285:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 8388608, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x4000 00010000:00010000:3.0:1789762815.783290:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789444f8 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.783306:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=118s v=(0 0) 00010000:00010000:1.0:1789762815.783318:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762815.783327:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 24 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.783338:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.783343:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762815.783349:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 24 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.783360:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762815.783364:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762815.783370:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 24 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.783398:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 24 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.783399:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 24 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.783404:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 24 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.783432:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2c00, rc 0) 00010000:00010000:1.0:1789762815.783434:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662000, rc 0) 00010000:00010000:2.0:1789762815.783447:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460a00, rc 0) 00000100:00100000:3.0:1789762815.783472:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:10392:x1876702246499072:12345-192.168.203.36@tcp:101:dd.0 Request processed in 218us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762815.783473:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:10391:x1876702246498944:12345-192.168.203.36@tcp:101:dd.0 Request processed in 247us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762815.783476:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:10390:x1876702246499200:12345-192.168.203.36@tcp:101:dd.0 Request processed in 231us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762815.783494:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:3.0:1789762815.783500:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:2.0:1789762815.783511:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:1.0:1789762815.787436:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762815.787534:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246499328 00000100:00100000:0.0:1789762815.787547:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246499328 00002000:00100000:0.0:1789762815.787592:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2:0x0] (0->1048575) req@ffff9b33f749ed80 x1876702246499328/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/0 e 0 to 0 dl 1789762826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762815.787606:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749ed80 with x1876702246499328 ext(0->1048575) 00002000:00010000:0.0:1789762815.787611:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f749ed80 00000100:00100000:0.0:1789762815.787626:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 1 deadline 118172376796 time 118172290564 state 0x0 ref 1 00000100:00100000:0.0:1789762815.787637:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 1 deadline 118172390564 time 118172290564 state 0x1 ref 1 00000100:00100000:0.0:1789762815.787662:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 118172390564 time 118224908123 state 0x0 ref 1 00000100:00100000:0.0:1789762815.787673:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2354:x1876702246499328:12345-192.168.203.36@tcp:3:dd.0 00000100:00100000:0.0:1789762815.792070:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2354:x1876702246499328:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4396us (4631us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762815.792081:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:0.0:1789762815.792086:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 118172390564 time 118224908123 state 0x2 ref 0 00002000:00100000:0.0:1789762815.792105:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2:0x0] (0->1048575) req@ffff9b33f749ed80 x1876702246499328/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:596/0 lens 488/440 e 0 to 0 dl 1789762826 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762815.792112:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f749ed80 with x1876702246499328 ext(0->1048575) 00002000:00010000:0.0:1789762815.792116:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f749ed80 00000100:00100000:0.0:1789762815.819700:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.819800:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246499584 00000100:00100000:2.0:1789762815.819813:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246499584 00000100:00100000:2.0:1789762815.819876:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:2.0:1789762815.819889:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+44:10397:x1876702246499584:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762815.820099:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+45:10397:x1876702246499584:12345-192.168.203.36@tcp:35:dd.0 Request processed in 214us (405us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789762815.820105:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1789762815.829896:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.829950:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246499712 00000100:00100000:1.0:1789762815.829957:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246499712 00000100:00100000:1.0:1789762815.829992:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:1.0:1789762815.829999:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+45:10406:x1876702246499712:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:1.0:1789762815.830015:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762815.830030:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944506 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.830084:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b5968c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.830100:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b5968c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.830113:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b5968c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762815.830163:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789762815.830166:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762815.830192:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b5968c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.830212:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944506 expref: 47 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.830226:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b5968c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944506 expref: 46 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.830233:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:1.0:1789762815.830235:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762815.830238:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f6000, rc 0) 00000100:00100000:1.0:1789762815.830272:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10406:x1876702246499712:12345-192.168.203.36@tcp:101:rm.0 Request processed in 274us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762815.830277:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:0.0:1789762815.831803:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.831855:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246499840 00000100:00100000:3.0:1789762815.831861:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246499840 00000100:00100000:3.0:1789762815.831890:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1789762815.831898:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10406:x1876702246499840:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:3.0:1789762815.835247:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10406:x1876702246499840:12345-192.168.203.36@tcp:37:rm.0 Request processed in 3343us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762815.835257:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:0.0:1789762815.836952:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.837012:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246499968 00000100:00100000:1.0:1789762815.837023:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246499968 00000100:00100000:1.0:1789762815.837076:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:1.0:1789762815.837085:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10406:x1876702246499968:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:1.0:1789762815.837143:0:9183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7384293376 00000100:00100000:1.0:1789762815.837214:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10406:x1876702246499968:12345-192.168.203.36@tcp:41:rm.0 Request processed in 129us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762815.837220:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:0.0:1789762815.838213:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762815.838269:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246500224 00000100:00100000:3.0:1789762815.838276:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246500224 00000100:00100000:3.0:1789762815.838317:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:3.0:1789762815.838324:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10406:x1876702246500224:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:3.0:1789762815.838359:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789762815.838378:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ea expref: 46 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838395:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7a00/0x5915dfb1c1b595e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ab expref: 45 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838413:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642e00/0x5915dfb1c1b594f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944457 expref: 44 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838421:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33fed74f00) 00010000:00010000:3.0:1789762815.838431:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b5968c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944506 expref: 43 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838438:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:3.0:1789762815.838440:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762815.838452:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838461:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838467:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838477:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838482:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838487:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838565:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838585:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838593:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789762815.838812:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789762815.838820:0:5924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 118276068264ns, next at 119276066488ns, rc = 0 00000040:00080000:3.0:1789762815.838833:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789762815.838836:0:5924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 118276084898ns, next at 119276084393ns, rc = 0 00010000:00010000:3.0:1789762815.838875:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838882:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838888:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838893:0:5924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838898:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838902:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838916:0:5924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762815.838927:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838939:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.838943:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762815.838945:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838954:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762815.838956:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838958:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838972:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.838975:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762815.838981:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33e2f49300) 00010000:00010000:3.0:1789762815.838985:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762815.838987:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.838990:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.838992:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.839012:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.839016:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.839023:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9b33e2f49300) 00010000:00010000:3.0:1789762815.839024:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.839030:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789762815.839036:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.839038:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.839050:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b596a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.839053:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762815.839065:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.839071:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762815.839074:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.839075:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762815.839088:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762815.839088:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:3.0:1789762815.839093:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762815.839096:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762815.839101:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b59693 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762815.839109:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000073f5796 reply state 00000000aeb058a1 transno 4294967331 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762815.839115:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762815.839159:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+44:10406:x1876702246500224:12345-192.168.203.36@tcp:36:rm.0 Request processed in 834us (949us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789762815.839164:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 64 00010000:00010000:1.0:1789762815.839700:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.839721:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.839727:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.839731:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762815.839735:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.839740:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.839781:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3950208a (ffff9b33e2f49f00) 00010000:00010000:1.0:1789762815.839784:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762815.839788:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.839793:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3800/0x5915dfb1c1b5969a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.841228:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.841267:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246500480 00000100:00100000:1.0:1789762815.841274:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246500480 00000100:00100000:1.0:1789762815.841308:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:1.0:1789762815.841317:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+43:10406:x1876702246500480:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:1.0:1789762815.841354:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789762815.841369:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5963f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444dc expref: 43 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841395:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2600/0x5915dfb1c1b59615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444c0 expref: 42 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841404:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b5952e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944465 expref: 41 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841411:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:1.0:1789762815.841416:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762815.841430:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841441:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841451:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841466:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841475:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841483:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841558:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841565:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841582:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789762815.841809:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000040:00080000:1.0:1789762815.841833:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00010000:00010000:1.0:1789762815.841875:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841885:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841893:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841915:0:5926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841922:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841927:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841943:0:5926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762815.841955:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841960:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841965:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.841965:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762815.841982:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.841998:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762815.842003:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842008:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762815.842010:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842016:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842020:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33d0148b00) 00010000:00010000:1.0:1789762815.842023:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762815.842026:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842046:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b596bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842052:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842063:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842068:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b33d0148b00) 00010000:00010000:1.0:1789762815.842069:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842081:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789762815.842083:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842089:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842090:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762815.842096:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842122:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842161:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b596c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842168:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:1.0:1789762815.842174:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762815.842179:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762815.842182:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762815.842185:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762815.842188:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762815.842195:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b596af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762815.842208:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e21f46ee reply state 00000000cda7378a transno 4294967332 ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762815.842214:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762815.842258:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10406:x1876702246500480:12345-192.168.203.36@tcp:36:rm.0 Request processed in 943us (1032us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789762815.842264:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 65 00010000:00010000:1.0:1789762815.842841:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842848:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842852:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842855:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762815.842858:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842862:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842883:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x25a23cf0 (ffff9b33d0148f00) 00010000:00010000:1.0:1789762815.842886:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762815.842889:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.842896:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b596b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762815.843301:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762815.843370:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246500736 00000100:00100000:2.0:1789762815.843377:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246500736 00000100:00100000:2.0:1789762815.843412:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:2.0:1789762815.843419:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10406:x1876702246500736:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762815.843541:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10406:x1876702246500736:12345-192.168.203.36@tcp:35:rm.0 Request processed in 122us (241us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789762815.843548:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:0.0:1789762815.844226:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762815.844262:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246500992 00000100:00100000:1.0:1789762815.844267:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246500992 00000100:00100000:1.0:1789762815.844295:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:1.0:1789762815.844302:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10406:x1876702246500992:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:1.0:1789762815.844326:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789762815.844336:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3c00/0x5915dfb1c1b5953c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894446c expref: 42 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844359:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b594c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944449 expref: 41 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844366:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33fed74e00) 00010000:00010000:1.0:1789762815.844375:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2000/0x5915dfb1c1b59463 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944434 expref: 40 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844381:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49500) 00010000:00010000:1.0:1789762815.844386:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762815.844397:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844411:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844417:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844426:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844430:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844436:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844479:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844488:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844494:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762815.844609:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789762815.844618:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844623:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844627:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844638:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762815.844642:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844648:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844657:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b33d0148500) 00010000:00010000:1.0:1789762815.844660:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762815.844663:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844670:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b596d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844688:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844692:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844697:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844700:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762815.844702:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844705:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844718:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:1.0:1789762815.844720:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762815.844722:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.844726:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b596cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762815.844734:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000974e9d7a reply state 00000000cefec820 transno 4294967334 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762815.844739:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762815.844815:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10406:x1876702246500992:12345-192.168.203.36@tcp:36:rm.0 Request processed in 510us (587us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789762815.844822:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00010000:00010000:1.0:1789762815.845279:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.845285:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.845289:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.845293:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762815.845295:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.845300:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.845315:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33d0148000) 00010000:00010000:1.0:1789762815.845317:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762815.845319:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762815.845323:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b596d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762815.866902:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762816.128358:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.128435:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246501120 00000100:00100000:3.0:1789762816.128444:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246501120 00000100:00100000:3.0:1789762816.128507:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:3.0:1789762816.128530:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:10417:x1876702246501120:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:3.0:1789762816.128551:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762816.128572:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b596e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894450d expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.128625:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.128643:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.128652:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762816.128689:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762816.128692:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762816.128707:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.128728:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b596e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894450d expref: 42 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.128743:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894450d expref: 41 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.128816:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49600) 00010000:00010000:3.0:1789762816.128819:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762816.128822:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e3400, rc 0) 00000100:00100000:3.0:1789762816.128871:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10417:x1876702246501120:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 355us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762816.128878:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1789762816.129888:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.129935:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246501376 00000100:00100000:1.0:1789762816.129945:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246501376 00000100:00100000:1.0:1789762816.129995:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:1.0:1789762816.130006:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10417:x1876702246501376:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:1.0:1789762816.130062:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762816.130090:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3400/0x5915dfb1c1b596e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894450d expref: 41 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130112:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49600) 00010000:00010000:1.0:1789762816.130126:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762816.130190:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130205:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130216:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130231:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130262:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130270:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762816.130877:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00010000:00010000:1.0:1789762816.130887:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130893:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130898:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130904:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.130909:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130916:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130923:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148000) 00010000:00010000:1.0:1789762816.130924:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.130927:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.130931:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b596ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762816.130955:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067b30cde reply state 0000000055f53849 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762816.130963:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762816.131031:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10417:x1876702246501376:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 1028us (1146us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789762816.131037:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00010000:00010000:1.0:1789762816.131560:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.131569:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.131574:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.131579:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.131582:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.131586:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.131594:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33d0148400) 00010000:00010000:1.0:1789762816.131596:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.131598:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.131601:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b596f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762816.135800:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.135838:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246501504 00000100:00100000:2.0:1789762816.135845:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246501504 00000100:00100000:2.0:1789762816.135884:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:2.0:1789762816.135893:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10418:x1876702246501504:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762816.135905:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762816.135916:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b596fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944514 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.135949:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59703 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.135958:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.135965:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762816.135995:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762816.135997:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762816.136008:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.136024:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b596fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944514 expref: 43 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.136042:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944514 expref: 42 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.136052:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9f00) 00010000:00010000:2.0:1789762816.136055:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762816.136058:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461c00, rc 0) 00000100:00100000:2.0:1789762816.136099:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10418:x1876702246501504:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 208us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762816.136107:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:0.0:1789762816.137039:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.137100:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246501760 00000100:00100000:1.0:1789762816.137108:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246501760 00000100:00100000:1.0:1789762816.137160:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:1.0:1789762816.137172:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10418:x1876702246501760:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762816.137185:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762816.137188:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789762816.137204:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59703 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944514 expref: 42 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137219:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9f00) 00010000:00010000:1.0:1789762816.137228:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762816.137241:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b5970a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894451b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137323:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137335:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137345:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137360:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137369:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137390:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137448:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137457:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137465:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762816.137474:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00010000:00010000:1.0:1789762816.137486:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137493:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137499:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137505:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eec00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.137508:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137515:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137540:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148200) 00010000:00010000:1.0:1789762816.137543:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.137554:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137561:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b5971f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137580:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137587:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137593:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137598:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efa00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.137601:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137608:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137617:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148500) 00010000:00010000:1.0:1789762816.137620:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.137624:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137629:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b59711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137648:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137655:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137670:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137676:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.137680:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137688:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137703:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33d0148f00) 00010000:00010000:1.0:1789762816.137707:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.137710:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137716:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b59718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137794:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b5970a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894451b expref: 42 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137806:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148500) 00010000:00010000:1.0:1789762816.137810:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.137815:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b5970a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894451b expref: 42 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.137838:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ee600, rc 0) 00000100:00100000:1.0:1789762816.137885:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10418:x1876702246501760:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 715us (846us total) trans 0 rc 301/301 00000100:00100000:1.0:1789762816.137905:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:3.0:1789762816.138681:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.138728:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246501888 00000100:00100000:1.0:1789762816.138735:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246501888 00000100:00100000:1.0:1789762816.138826:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:1.0:1789762816.138841:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:10418:x1876702246501888:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762816.138852:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762816.138864:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944522 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.138901:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b5972d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.138912:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b5972d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.138922:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b5972d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762816.138943:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762816.138947:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762816.138964:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b5972d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.138984:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944522 expref: 43 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.139002:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b5972d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944522 expref: 42 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.139022:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:1.0:1789762816.139025:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762816.139028:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13eea00, rc 0) 00000100:00100000:1.0:1789762816.139071:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10418:x1876702246501888:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 236us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762816.139081:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:3.0:1789762816.139971:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.140001:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246502144 00000100:00100000:2.0:1789762816.140007:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246502144 00000100:00100000:2.0:1789762816.140041:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:2.0:1789762816.140053:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:10418:x1876702246502144:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762816.140065:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762816.140077:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944529 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140118:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140136:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140142:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140161:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140170:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140178:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762816.140256:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1789762816.140310:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140318:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140326:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140333:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762816.140338:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140346:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140368:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:2.0:1789762816.140370:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762816.140373:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140377:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5973b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140385:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140390:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140394:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140398:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762816.140400:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140403:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140408:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33ed2a9c00) 00010000:00010000:2.0:1789762816.140410:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762816.140411:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140415:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140448:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59734 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944529 expref: 44 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140456:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:2.0:1789762816.140458:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762816.140461:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944529 expref: 44 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.140467:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460000, rc 0) 00000100:00100000:2.0:1789762816.140498:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+43:10418:x1876702246502144:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 450us (528us total) trans 4294967336 rc 301/301 00000100:00100000:2.0:1789762816.140503:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:2.0:1789762816.141291:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.141364:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246502400 00000100:00100000:1.0:1789762816.141371:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246502400 00000100:00100000:1.0:1789762816.141417:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:1.0:1789762816.141431:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b340041a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+43:10418:x1876702246502400:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:1.0:1789762816.141472:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.141482:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.141489:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762816.141589:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003558c1b0 reply state 000000002166f4cc transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762816.141596:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762816.141601:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00000100:00100000:1.0:1789762816.141648:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b340041a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+45:10418:x1876702246502400:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 223us (357us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789762816.141654:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00010000:00010000:1.0:1789762816.142099:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.142105:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.142110:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.142114:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.142118:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.142123:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.142131:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148000) 00010000:00010000:1.0:1789762816.142133:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789762816.142136:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.142141:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59750 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762816.142592:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.142622:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246502656 00000100:00100000:3.0:1789762816.142629:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246502656 00000100:00100000:3.0:1789762816.142714:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1789762816.142727:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0aff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+44:10418:x1876702246502656:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1789762816.142904:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0aff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+45:10418:x1876702246502656:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 180us (312us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789762816.142914:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1789762816.147437:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.147490:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246502784 00000100:00100000:1.0:1789762816.147498:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246502784 00000100:00100000:1.0:1789762816.147558:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:1.0:1789762816.147569:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+45:10419:x1876702246502784:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1789762816.147584:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762816.147597:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944530 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147654:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147664:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147673:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147689:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147697:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147705:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147808:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b5976c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147817:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b5976c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147826:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b5976c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762816.147850:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1789762816.147854:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762816.147868:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b5976c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147892:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147899:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147906:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147913:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.147917:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147925:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147937:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:1.0:1789762816.147940:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.147945:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147952:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5975e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147966:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147973:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147980:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.147993:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.147997:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.148004:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.148013:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33d0148000) 00010000:00010000:1.0:1789762816.148016:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.148019:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.148026:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59765 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.148054:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944530 expref: 47 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.148068:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b5976c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944530 expref: 46 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.148076:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148500) 00010000:00010000:1.0:1789762816.148079:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762816.148081:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ee000, rc 0) 00000100:00100000:1.0:1789762816.148133:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10419:x1876702246502784:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 566us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762816.148144:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:3.0:1789762816.149119:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.149151:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246503040 00000100:00100000:2.0:1789762816.149158:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246503040 00000100:00100000:2.0:1789762816.149197:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:2.0:1789762816.149208:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10419:x1876702246503040:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:2.0:1789762816.149242:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762816.149258:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee000/0x5915dfb1c1b5976c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944530 expref: 46 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.149271:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148500) 00010000:00010000:2.0:1789762816.149279:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762816.149294:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.149313:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.149320:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762816.149427:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055219805 reply state 000000007cb5e8a3 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762816.149435:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762816.149439:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00000100:00100000:2.0:1789762816.149498:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+47:10419:x1876702246503040:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 291us (378us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1789762816.149507:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 75 00010000:00010000:1.0:1789762816.149949:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.149966:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.149974:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.149981:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.149984:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.149991:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.150004:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33ed2a9c00) 00010000:00010000:1.0:1789762816.150007:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789762816.150011:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.150018:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59773 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.155320:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.155394:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246503168 00000100:00100000:1.0:1789762816.155401:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246503168 00000100:00100000:1.0:1789762816.155448:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:1.0:1789762816.155461:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:10420:x1876702246503168:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:1.0:1789762816.155472:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762816.155481:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b5977a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944537 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155538:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155550:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155557:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155567:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155572:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155578:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155613:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b5978f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155618:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b5978f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155624:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b5978f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762816.155639:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1789762816.155642:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762816.155652:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b5978f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155659:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155671:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155676:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155681:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.155683:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155688:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155696:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:1.0:1789762816.155698:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.155700:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155704:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee600/0x5915dfb1c1b59781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155712:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155716:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155721:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155724:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.155731:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155735:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155740:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33d0148000) 00010000:00010000:1.0:1789762816.155742:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.155743:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155747:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59788 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155831:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b5977a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944537 expref: 48 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155845:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b5978f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944537 expref: 47 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.155850:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:1.0:1789762816.155852:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789762816.155855:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13efa00, rc 0) 00000100:00100000:1.0:1789762816.155896:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+47:10420:x1876702246503168:12345-192.168.203.36@tcp:101:touch.0 Request processed in 441us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762816.155902:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:2.0:1789762816.156877:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.156922:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246503424 00000100:00100000:1.0:1789762816.156928:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246503424 00000100:00100000:1.0:1789762816.156983:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:1.0:1789762816.156996:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+47:10420:x1876702246503424:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:1.0:1789762816.157012:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762816.157022:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59796 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894453e expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157068:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157076:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157085:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157104:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157114:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157120:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762816.157366:0:5926:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789762816.157458:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b597ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157465:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b597ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157471:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b597ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157503:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157508:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157513:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157516:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.157531:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157536:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157542:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:1.0:1789762816.157544:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.157548:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157553:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5979d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762816.157561:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d911cf33 reply state 00000000d4cd0fa2 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762816.157566:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762816.157585:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59796 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894453e expref: 50 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157605:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b597ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894453e expref: 49 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.157610:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33d0148c00) 00010000:00010000:1.0:1789762816.157612:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762816.157614:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ef000, rc 0) 00000100:00100000:1.0:1789762816.157657:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+50:10420:x1876702246503424:12345-192.168.203.36@tcp:101:touch.0 Request processed in 668us (785us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789762816.157664:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00010000:00010000:1.0:1789762816.158221:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.158230:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.158235:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.158241:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.158244:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.158249:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.158261:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff9b33d0148200) 00010000:00010000:1.0:1789762816.158264:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.158267:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.158279:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.158817:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.158946:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246503680 00000100:00100000:2.0:1789762816.158953:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246503680 00000100:00100000:2.0:1789762816.159023:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:2.0:1789762816.159045:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+49:10420:x1876702246503680:12345-192.168.203.36@tcp:36:touch.0 00010000:00010000:2.0:1789762816.159089:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762816.159115:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b597ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894453e expref: 49 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.159135:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33d0148c00) 00010000:00010000:2.0:1789762816.159147:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762816.159185:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.159204:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.159212:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762816.159273:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fae344f7 reply state 00000000b1728d9d transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762816.159279:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762816.159346:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+50:10420:x1876702246503680:12345-192.168.203.36@tcp:36:touch.0 Request processed in 311us (534us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789762816.159355:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:0.0:1789762816.160885:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1789762816.160909:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.160917:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.160922:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.160928:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762816.160931:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.160937:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.160948:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33ed2a9d00) 00010000:00010000:0.0:1789762816.160951:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762816.160954:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.160959:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b597b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762816.160997:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246503808 00000100:00100000:0.0:1789762816.161004:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246503808 00000100:00100000:0.0:1789762816.161054:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:0.0:1789762816.161065:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+49:10420:x1876702246503808:12345-192.168.203.36@tcp:101:touch.0 00010000:00010000:0.0:1789762816.161077:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762816.161091:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643200/0x5915dfb1c1b597c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944545 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.161126:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643200/0x5915dfb1c1b597c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944545 expref: 50 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.161136:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643200/0x5915dfb1c1b597c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944545 expref: 50 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.161149:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:0.0:1789762816.161151:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789762816.161153:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4643200, rc 0) 00000100:00100000:0.0:1789762816.161184:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+50:10420:x1876702246503808:12345-192.168.203.36@tcp:101:touch.0 Request processed in 121us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762816.161191:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:1.0:1789762816.162002:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.162147:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246503936 00000100:00100000:2.0:1789762816.162152:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246503936 00000100:00100000:2.0:1789762816.162194:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:2.0:1789762816.162202:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2354:x1876702246503936:12345-192.168.203.36@tcp:2:touch.0 00000100:00080000:1.0:1789762816.162213:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762816.162326:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:2354:x1876702246503936:12345-192.168.203.36@tcp:2:touch.0 Request processed in 122us (324us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789762816.162332:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:0.0:1789762816.163051:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.163103:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246504192 00000100:00100000:2.0:1789762816.163108:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246504192 00000100:00100000:2.0:1789762816.163138:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:2.0:1789762816.163148:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+50:10420:x1876702246504192:12345-192.168.203.36@tcp:35:touch.0 00000100:00100000:2.0:1789762816.163270:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+51:10420:x1876702246504192:12345-192.168.203.36@tcp:35:touch.0 Request processed in 126us (226us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789762816.163275:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1789762816.167442:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762816.167488:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246504320 00000100:00100000:1.0:1789762816.167494:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246504320 00000100:00100000:1.0:1789762816.167558:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:1.0:1789762816.167573:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+51:10421:x1876702246504320:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1789762816.167587:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762816.167600:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894454c expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167632:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167665:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167675:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167690:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167697:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167705:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167785:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b597dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167792:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b597dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167798:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b597dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762816.167818:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789762816.167821:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762816.167831:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b597dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167838:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b597dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167844:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167848:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167852:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167857:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eec00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.167861:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167866:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167881:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:1.0:1789762816.167883:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.167885:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167890:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b597ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167904:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167908:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167913:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167918:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762816.167921:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167925:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167930:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff9b33d0148200) 00010000:00010000:1.0:1789762816.167931:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762816.167933:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167937:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b597d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167966:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef400/0x5915dfb1c1b597c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894454c expref: 53 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167977:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b597dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894454c expref: 52 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.167983:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:1.0:1789762816.167984:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762816.167986:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ee800, rc 0) 00000100:00100000:1.0:1789762816.168018:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+52:10421:x1876702246504320:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 452us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762816.168023:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:1.0:1789762816.169038:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762816.169087:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246504448 00000100:00100000:0.0:1789762816.169093:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246504448 00000100:00100000:0.0:1789762816.169139:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:0.0:1789762816.169150:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:2353:x1876702246504448:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:0.0:1789762816.169168:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762816.169185:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944553 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762816.169207:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad9d00, atime: 0x6aad9d00, ctime: 0x6aad9d00, blocks: 0x0 00010000:00010000:0.0:1789762816.169224:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=118s v=(0 0) 00010000:00010000:0.0:1789762816.169230:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762816.169238:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 24 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.169255:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 24 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.169265:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4643e00, rc 0) 00000100:00100000:0.0:1789762816.169306:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:2353:x1876702246504448:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 159us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762816.169313:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:1.0:1789762816.171136:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.171211:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246504704 00000100:00100000:3.0:1789762816.171220:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246504704 00000100:00100000:3.0:1789762816.171280:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:3.0:1789762816.171296:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+52:10421:x1876702246504704:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:3.0:1789762816.171340:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762816.171373:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b597dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894454c expref: 52 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.171393:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:3.0:1789762816.171398:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762816.171422:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.171436:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.171447:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762816.171579:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002af8d8b4 reply state 000000007ffaf23e transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.171599:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762816.171672:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+53:10421:x1876702246504704:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 384us (543us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789762816.171678:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00010000:00010000:0.0:1789762816.172460:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.172467:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.172472:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.172476:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762816.172479:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.172490:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.172498:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:0.0:1789762816.172500:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762816.172503:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.172509:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2400/0x5915dfb1c1b597ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762816.172641:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.172688:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246504832 00000100:00100000:2.0:1789762816.172695:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246504832 00000100:00100000:2.0:1789762816.172738:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:2.0:1789762816.172778:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:2354:x1876702246504832:12345-192.168.203.36@tcp:2:chmod.0 00002000:00010000:2.0:1789762816.172864:0:6911:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762816.172868:0:6911:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762816 -> 1789762816 00002000:00010000:2.0:1789762816.172871:0:6911:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789762816 -> 1789762816 00002000:00010000:2.0:1789762816.172874:0:6911:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762816 -> 1789762816 00002000:00010000:2.0:1789762816.172876:0:6911:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789762816.172917:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:2354:x1876702246504832:12345-192.168.203.36@tcp:2:chmod.0 Request processed in 170us (276us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789762816.172926:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1789762816.190159:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762816.190226:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246505088 00000100:00100000:0.0:1789762816.190238:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246505088 00000100:00100000:0.0:1789762816.190282:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:0.0:1789762816.190289:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+52:10427:x1876702246505088:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:0.0:1789762816.190307:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762816.190319:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b597f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894455a expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190464:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190475:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190483:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190493:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190507:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190512:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190565:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b59806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190571:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b59806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190576:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b59806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762816.190582:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789762816.190633:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190638:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190643:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190647:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762816.190650:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190655:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190670:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:0.0:1789762816.190672:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762816.190675:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190679:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642600/0x5915dfb1c1b597f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190687:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190691:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190694:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190698:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762816.190700:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190704:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190708:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff9b33fed74900) 00010000:00010000:0.0:1789762816.190710:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762816.190711:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190715:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642800/0x5915dfb1c1b597ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190777:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642a00/0x5915dfb1c1b597f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894455a expref: 55 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190789:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b59806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894455a expref: 54 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.190795:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:0.0:1789762816.190797:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762816.190799:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f4642c00, rc 0) 00000100:00100000:0.0:1789762816.190840:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+54:10427:x1876702246505088:12345-192.168.203.36@tcp:101:dd.500 Request processed in 552us (691us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789762816.190845:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:1.0:1789762816.191856:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.191900:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246505216 00000100:00100000:3.0:1789762816.191906:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246505216 00000100:00100000:3.0:1789762816.191937:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:3.0:1789762816.191944:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+54:10427:x1876702246505216:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762816.191954:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762816.191962:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59814 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944561 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.191980:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b5981b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.191987:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b5981b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.191993:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b5981b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.192051:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3a00/0x5915dfb1c1b59814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944561 expref: 56 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.192061:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b5981b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944561 expref: 55 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.192067:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:3.0:1789762816.192074:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762816.192076:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2800, rc 0) 00000100:00100000:3.0:1789762816.192107:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+55:10427:x1876702246505216:12345-192.168.203.36@tcp:101:dd.500 Request processed in 164us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762816.192113:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:1.0:1789762816.192954:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.193034:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246505472 00000100:00100000:3.0:1789762816.193039:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246505472 00000100:00100000:3.0:1789762816.193065:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:3.0:1789762816.193071:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+55:10427:x1876702246505472:12345-192.168.203.36@tcp:36:dd.500 00010000:00010000:3.0:1789762816.193091:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762816.193101:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4642c00/0x5915dfb1c1b59806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894455a expref: 55 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.193110:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:3.0:1789762816.193112:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762816.193182:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.193190:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.193195:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762816.193224:0:9183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:3.0:1789762816.193236:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005174c4a8 reply state 0000000058092f5c transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.193243:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762816.193300:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+57:10427:x1876702246505472:12345-192.168.203.36@tcp:36:dd.500 Request processed in 227us (346us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789762816.193316:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000020:00080000:3.0:1789762816.193320:0:9183:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789762816.193842:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.193851:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.193857:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.193861:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762816.193863:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.193867:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.193874:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:0.0:1789762816.193883:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762816.193886:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.193890:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3600/0x5915dfb1c1b59822 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762816.194001:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.194044:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246505600 00000100:00100000:2.0:1789762816.194051:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246505600 00000100:00100000:2.0:1789762816.194092:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:2.0:1789762816.194104:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:10427:x1876702246505600:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762816.194114:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762816.194125:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944568 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.194149:0:7959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 26 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.194159:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762816.194164:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762816.194170:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 26 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.194207:0:7959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 26 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.194222:0:7959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 26 pid: 6912 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762816.194237:0:7959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3400418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7959:1876702254897408:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762816.194317:0:7959:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f7229a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762816.195025:0:7959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3400418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7959:1876702254897408:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762816.195046:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 26 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.195060:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461600, rc 0) 00000100:00100000:2.0:1789762816.195097:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:10427:x1876702246505600:12345-192.168.203.36@tcp:101:dd.500 Request processed in 995us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762816.195106:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:2.0:1789762816.195230:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.195290:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246505728 00000100:00100000:3.0:1789762816.195296:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246505728 00010000:00010000:3.0:1789762816.195313:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 26 pid: 6912 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.195336:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1789762816.195341:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2353:x1876702246505728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762816.195349:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762816.195353:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 26 pid: 6912 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.195365:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 26 pid: 6912 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.195384:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b597e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944553 expref: 26 pid: 6912 timeout: 218 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.195395:0:5954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762816.195399:0:5954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762816.195405:0:5954:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 25 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.195416:0:5954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 25 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.195450:0:5954:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 25 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.195462:0:5954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f453c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5954:1876702254897536:192.168.203.36@tcp:105: 00000100:00100000:3.0:1789762816.195504:0:5954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f769fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789762816.196300:0:5954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f453c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5954:1876702254897536:192.168.203.36@tcp:105: 00010000:00010000:3.0:1789762816.196358:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762816.196384:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:2353:x1876702246505728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1042us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762816.196391:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1789762816.196498:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.196574:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246505856 00000100:00100000:3.0:1789762816.196578:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246505856 00002000:00010000:3.0:1789762816.196594:0:6917:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:3.0:1789762816.196597:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f47f9880 with x1876702246505856 ext(0->18446744073709551615) 00002000:00010000:3.0:1789762816.196603:0:6917:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f47f9880. 00000100:00100000:3.0:1789762816.196613:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118145738235 time 118145925220 state 0x0 ref 1 00000100:00100000:3.0:1789762816.196621:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118345925220 time 118145925220 state 0x1 ref 1 00000100:00100000:3.0:1789762816.196638:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 118345925220 time 118633884217 state 0x0 ref 1 00000100:00100000:3.0:1789762816.196645:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:2353:x1876702246505856:12345-192.168.203.36@tcp:10:dd.500 00002000:00010000:3.0:1789762816.196734:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762816.196737:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762816 -> 1789762816 00002000:00010000:3.0:1789762816.196745:0:6917:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789762816 -> 1789762816 00002000:00010000:3.0:1789762816.196748:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762816 -> 1789762816 00002000:00010000:3.0:1789762816.196775:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789762816.196812:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2353:x1876702246505856:12345-192.168.203.36@tcp:10:dd.500 Request processed in 165us (313us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789762816.196819:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1789762816.196824:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 118345925220 time 118633884217 state 0x2 ref 0 00002000:00010000:3.0:1789762816.196828:0:6917:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:3.0:1789762816.196830:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f47f9880 with x1876702246505856 ext(0->18446744073709551615) 00002000:00010000:3.0:1789762816.196835:0:6917:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f47f9880. 00000100:00100000:1.0:1789762816.199331:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762816.199380:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246505984 00000100:00100000:0.0:1789762816.199386:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246505984 00000100:00100000:0.0:1789762816.199408:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 118345925220 time 118633884217 state 0x0 ref 1 00000100:00100000:0.0:1789762816.199415:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 1 deadline 118833884217 time 118633884217 state 0x1 ref 1 00000100:00100000:0.0:1789762816.199434:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118833884217 time 118636681735 state 0x0 ref 1 00000100:00100000:0.0:1789762816.199444:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2354:x1876702246505984:12345-192.168.203.36@tcp:4:dd.500 00010000:00010000:0.0:1789762816.199462:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.199475:0:12139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 26 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.199481:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762816.199483:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762816.199486:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.199502:0:12139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 26 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.199535:0:12139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 26 pid: 7959 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762816.199544:0:12139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33fee3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:12139:1876702254897664:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762816.199583:0:12139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33e0c889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762816.200329:0:12139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33fee3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:12139:1876702254897664:192.168.203.36@tcp:104: 00010000:00010000:0.0:1789762816.200342:0:12139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762816.200483:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.200516:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246506112 00000100:00100000:3.0:1789762816.200532:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246506112 00010000:00010000:3.0:1789762816.200596:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 27 pid: 7959 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.200621:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:3.0:1789762816.200628:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:2353:x1876702246506112:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762816.200637:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762816.200647:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 27 pid: 7959 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.200656:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 27 pid: 7959 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.200667:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59829 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944568 expref: 27 pid: 7959 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.200682:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762816.200685:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762816.200688:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.200695:0:5911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.200711:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762816.200731:0:12139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.200739:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2353:x1876702246506112:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 108us (255us total) trans 0 rc 0/0 00010000:00010000:0.0:1789762816.200744:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.200780:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000001:00080000:3.0:1789762816.206330:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00002000:00010000:2.0:1789762816.206430:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1789762816.206435:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1789762816.206444:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.206454:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.206469:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.206477:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762816.206481:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.206491:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.206503:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.206512:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59830 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762816.206581:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246505984:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7137us (7249us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789762816.206590:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:2.0:1789762816.206596:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118833884217 time 118636681735 state 0x2 ref 0 00000100:00100000:1.0:1789762816.219902:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762816.219967:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246506240 00000100:00100000:0.0:1789762816.219979:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246506240 00000100:00100000:0.0:1789762816.220019:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118833884217 time 118636681735 state 0x0 ref 1 00000100:00100000:0.0:1789762816.220029:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118836681735 time 118636681735 state 0x1 ref 1 00000100:00100000:0.0:1789762816.399510:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118836681735 time 118836749073 state 0x0 ref 1 00000100:00100000:0.0:1789762816.399551:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246506240:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762816.399598:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 1048576, mtime: 0x6aad9d00, atime: 0x6aad9d00, ctime: 0x6aad9d00, blocks: 0x800 00010000:00010000:0.0:1789762816.399616:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.399630:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=118s v=(0 0) 00010000:00010000:0.0:1789762816.399634:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762816.399639:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762816.399650:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762816.405441:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00002000:00010000:3.0:1789762816.405551:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1789762816.405556:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:3.0:1789762816.405565:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.405573:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.405580:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.405587:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762816.405592:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.405610:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.405629:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.405640:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59837 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.405695:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246506240:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6156us (185797us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789762816.405706:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1789762816.405711:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118836681735 time 118836749073 state 0x2 ref 0 00000100:00100000:1.0:1789762816.407883:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.407978:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246506368 00000100:00100000:2.0:1789762816.407993:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246506368 00000100:00100000:2.0:1789762816.408049:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 118836681735 time 118836749073 state 0x0 ref 1 00000100:00100000:2.0:1789762816.408060:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119036749073 time 118836749073 state 0x1 ref 1 00000100:00100000:1.0:1789762816.599616:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119036749073 time 119036854246 state 0x0 ref 1 00000100:00100000:1.0:1789762816.599643:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246506368:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762816.599703:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 2097152, mtime: 0x6aad9d00, atime: 0x6aad9d00, ctime: 0x6aad9d00, blocks: 0x1000 00010000:00010000:1.0:1789762816.599710:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.599723:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=119s v=(0 0) 00010000:00010000:1.0:1789762816.599726:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762816.599731:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762816.599744:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762816.605440:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00002000:00010000:3.0:1789762816.605535:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1789762816.605541:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:3.0:1789762816.605549:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.605558:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.605564:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.605569:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762816.605580:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.605586:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.605600:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.605606:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b5983e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762816.605656:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246506368:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6025us (197775us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789762816.605666:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:3.0:1789762816.605673:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119036749073 time 119036854246 state 0x2 ref 0 00000100:00100000:0.0:1789762816.607833:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762816.607883:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246506496 00000100:00100000:2.0:1789762816.607893:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246506496 00000100:00100000:2.0:1789762816.607932:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119036749073 time 119036854246 state 0x0 ref 1 00000100:00100000:2.0:1789762816.607943:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119236854246 time 119036854246 state 0x1 ref 1 00000100:00100000:2.0:1789762816.799681:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119236854246 time 119236919506 state 0x0 ref 1 00000100:00100000:2.0:1789762816.799710:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246506496:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762816.799792:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 3145728, mtime: 0x6aad9d00, atime: 0x6aad9d00, ctime: 0x6aad9d00, blocks: 0x1800 00010000:00010000:2.0:1789762816.799800:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.799813:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=119s v=(0 0) 00010000:00010000:2.0:1789762816.799817:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762816.799822:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.799833:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762816.805975:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00002000:00010000:2.0:1789762816.806051:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1789762816.806057:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:2.0:1789762816.806067:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.806075:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.806087:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.806092:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762816.806096:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.806103:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.806116:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762816.806122:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59845 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762816.806174:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246506496:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6477us (198343us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789762816.806181:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:2.0:1789762816.806185:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119236854246 time 119236919506 state 0x2 ref 0 00000100:00100000:1.0:1789762816.808285:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762816.808342:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246506624 00000100:00100000:3.0:1789762816.808353:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246506624 00000100:00100000:3.0:1789762816.808401:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119236854246 time 119236919506 state 0x0 ref 1 00000100:00100000:3.0:1789762816.808411:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119436919506 time 119236919506 state 0x1 ref 1 00010000:00010000:1.0:1789762816.890899:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762816.999797:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119436919506 time 119437031303 state 0x0 ref 1 00000100:00100000:3.0:1789762816.999843:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246506624:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762816.999922:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 4194304, mtime: 0x6aad9d00, atime: 0x6aad9d00, ctime: 0x6aad9d00, blocks: 0x2000 00010000:00010000:3.0:1789762816.999934:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762816.999973:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=119s v=(0 0) 00010000:00010000:3.0:1789762816.999979:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762816.999988:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.000004:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762817.005773:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00002000:00010000:3.0:1789762817.005866:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1789762817.005872:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762816 -> 1789762817 00002000:00010000:3.0:1789762817.005876:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762816 -> 1789762817 00002000:00010000:3.0:1789762817.005879:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:3.0:1789762817.005891:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.005903:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.005914:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.005922:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762817.005928:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.005940:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.005969:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.005978:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5984c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762817.006057:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246506624:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6236us (197776us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789762817.006068:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1789762817.006076:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119436919506 time 119437031303 state 0x2 ref 0 00000100:00100000:1.0:1789762817.008162:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762817.008226:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246506752 00000100:00100000:3.0:1789762817.008238:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246506752 00000100:00100000:3.0:1789762817.008281:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119436919506 time 119437031303 state 0x0 ref 1 00000100:00100000:3.0:1789762817.008295:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119637031303 time 119437031303 state 0x1 ref 1 00000100:00100000:0.0:1789762817.199850:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119637031303 time 119637088571 state 0x0 ref 1 00000100:00100000:0.0:1789762817.199879:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246506752:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762817.199927:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 5242880, mtime: 0x6aad9d01, atime: 0x6aad9d00, ctime: 0x6aad9d01, blocks: 0x2800 00010000:00010000:0.0:1789762817.199935:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.199948:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=119s v=(0 0) 00010000:00010000:0.0:1789762817.199952:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762817.199957:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.199996:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762817.205863:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00002000:00010000:3.0:1789762817.205952:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1789762817.205960:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:3.0:1789762817.205973:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.205983:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.205990:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.206007:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762817.206011:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.206018:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.206036:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.206041:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59853 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762817.206115:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246506752:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6247us (197956us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789762817.206124:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1789762817.206132:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119637031303 time 119637088571 state 0x2 ref 0 00000100:00100000:1.0:1789762817.208281:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762817.208334:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246506880 00000100:00100000:2.0:1789762817.208345:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246506880 00000100:00100000:2.0:1789762817.208392:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119637031303 time 119637088571 state 0x0 ref 1 00000100:00100000:2.0:1789762817.208403:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119837088571 time 119637088571 state 0x1 ref 1 00000100:00100000:2.0:1789762817.399944:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119837088571 time 119837177858 state 0x0 ref 1 00000100:00100000:2.0:1789762817.399980:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246506880:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762817.400046:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 6291456, mtime: 0x6aad9d01, atime: 0x6aad9d00, ctime: 0x6aad9d01, blocks: 0x3000 00010000:00010000:2.0:1789762817.400055:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.400071:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=119s v=(0 0) 00010000:00010000:2.0:1789762817.400075:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.400081:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.400094:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762817.406908:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00002000:00010000:2.0:1789762817.406995:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1789762817.407002:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:2.0:1789762817.407015:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.407026:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.407033:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.407048:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762817.407052:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.407060:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.407077:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.407082:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5985a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762817.407170:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246506880:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7205us (198887us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789762817.407179:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:2.0:1789762817.407187:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119837088571 time 119837177858 state 0x2 ref 0 00000100:00100000:0.0:1789762817.409629:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762817.409666:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507008 00000100:00100000:3.0:1789762817.409677:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507008 00000100:00100000:3.0:1789762817.409727:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 119837088571 time 119837177858 state 0x0 ref 1 00000100:00100000:3.0:1789762817.409739:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120037177858 time 119837177858 state 0x1 ref 1 00000100:00100000:2.0:1789762817.600069:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120037177858 time 120037301233 state 0x0 ref 1 00000100:00100000:2.0:1789762817.600107:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246507008:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762817.600175:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 7340032, mtime: 0x6aad9d01, atime: 0x6aad9d00, ctime: 0x6aad9d01, blocks: 0x3800 00010000:00010000:2.0:1789762817.600184:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.600223:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=120s v=(0 0) 00010000:00010000:2.0:1789762817.600227:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762817.600233:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762817.600255:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762817.606707:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00002000:00010000:0.0:1789762817.606831:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:0.0:1789762817.606838:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:0.0:1789762817.606852:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.606867:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.606877:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.606886:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762817.606892:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.606901:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.606923:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762817.606947:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59861 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762817.607023:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246507008:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6932us (197394us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789762817.607036:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:0.0:1789762817.607047:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120037177858 time 120037301233 state 0x2 ref 0 00000100:00100000:0.0:1789762817.609153:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762817.609206:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507136 00000100:00100000:3.0:1789762817.609214:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507136 00000100:00100000:3.0:1789762817.609253:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120037177858 time 120037301233 state 0x0 ref 1 00000100:00100000:3.0:1789762817.609262:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120237301233 time 120037301233 state 0x1 ref 1 00000100:00100000:3.0:1789762817.800141:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120237301233 time 120237378385 state 0x0 ref 1 00000100:00100000:3.0:1789762817.800170:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246507136:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762817.800217:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad9d01, atime: 0x6aad9d00, ctime: 0x6aad9d01, blocks: 0x4000 00010000:00010000:3.0:1789762817.800225:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.800239:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=120s v=(0 0) 00010000:00010000:3.0:1789762817.800243:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762817.800247:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.800258:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762817.805973:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00002000:00010000:3.0:1789762817.806064:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:3.0:1789762817.806072:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:3.0:1789762817.806084:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.806095:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.806102:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.806115:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762817.806120:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.806127:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.806154:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762817.806159:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59868 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762817.806236:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246507136:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6077us (197082us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789762817.806246:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:3.0:1789762817.806253:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120237301233 time 120237378385 state 0x2 ref 0 00000100:00100000:0.0:1789762817.808788:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762817.808839:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507264 00000100:00100000:2.0:1789762817.808849:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507264 00000100:00100000:2.0:1789762817.808894:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120237301233 time 120237378385 state 0x0 ref 1 00000100:00100000:2.0:1789762817.808907:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120437378385 time 120237378385 state 0x1 ref 1 00000004:00080000:1.0:1789762817.850924:0:8698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 120288168117ns, next at 121288164296ns, rc = 0 00000100:00100000:3.0:1789762817.850960:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254897792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762817.850969:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254898176:0@lo:400:kworker.0 00000100:00100000:0.0:1789762817.850971:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254898048:0@lo:400:kworker.0 00000100:00100000:2.0:1789762817.851025:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254897920:0@lo:400:kworker.0 00000100:00100000:3.0:1789762817.851034:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762817.851062:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762817.851093:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254897792 00000100:00100000:1.0:1789762817.851104:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254897792 00000100:00100000:3.0:1789762817.851116:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254898304:0@lo:400:kworker.0 00000100:00100000:2.0:1789762817.851117:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762817.851144:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254898560:0@lo:400:kworker.0 00000100:00100000:3.0:1789762817.851155:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762817.851187:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254898432:0@lo:400:kworker.0 00000100:00100000:1.0:1789762817.851199:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789762817.851209:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762817.851222:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254897792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762817.851227:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898304 00000100:00100000:3.0:1789762817.851235:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898304 00000100:00100000:2.0:1789762817.851238:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789762817.851272:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67732032 pending 16973824 free 3906891776 avail 3675369472 00000100:00100000:0.0:1789762817.851275:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898560 00000100:00100000:0.0:1789762817.851285:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898560 00000100:00100000:2.0:1789762817.851295:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254897920 00000100:00100000:2.0:1789762817.851300:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254897920 00000100:00100000:3.0:1789762817.851311:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789762817.851336:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254898304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762817.851360:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254897792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762817.851361:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789762817.851371:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789762817.851387:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254898304:12345-0@lo:400:kworker.0 Request processed in 52us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762817.851400:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789762817.851401:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254898560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762817.851401:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254897920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762817.851401:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789762817.851472:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762817.851485:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762817.851486:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254897920:12345-0@lo:400:kworker.0 Request processed in 98us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762817.851496:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789762817.851530:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762817.851536:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254898304:0@lo:400:kworker.0 00000100:00100000:0.0:1789762817.851539:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254898560:12345-0@lo:400:kworker.0 Request processed in 146us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762817.851556:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789762817.851582:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254897920:0@lo:400:kworker.0 00000100:00100000:3.0:1789762817.851589:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254897792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762817.851628:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898048 00000100:00100000:1.0:1789762817.851633:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898048 00000100:00100000:0.0:1789762817.851644:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254898560:0@lo:400:kworker.0 00000100:00100000:2.0:1789762817.851666:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898432 00000100:00100000:3.0:1789762817.851668:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898176 00000100:00100000:2.0:1789762817.851674:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898432 00000100:00100000:3.0:1789762817.851675:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898176 00000100:00100000:1.0:1789762817.851688:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789762817.851699:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254898048:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789762817.851727:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762817.851739:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789762817.851782:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254898432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762817.851796:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789762817.851812:0:9183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1789762817.851815:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254898048:12345-0@lo:400:kworker.0 Request processed in 116us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762817.851820:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254898176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762817.851824:0:9183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1789762817.851844:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789762817.851846:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254898432:12345-0@lo:400:kworker.0 Request processed in 89us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762817.851859:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789762817.851882:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254898048:0@lo:400:kworker.0 00000100:00100000:3.0:1789762817.851915:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254898176:12345-0@lo:400:kworker.0 Request processed in 99us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762817.851923:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33e0dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254898432:0@lo:400:kworker.0 00000100:00100000:3.0:1789762817.851927:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789762817.851959:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254898176:0@lo:400:kworker.0 00010000:00010000:0.0:1789762817.914905:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762818.000287:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120437378385 time 120437521671 state 0x0 ref 1 00000100:00100000:1.0:1789762818.000343:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246507264:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762818.000412:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 9437184, mtime: 0x6aad9d01, atime: 0x6aad9d00, ctime: 0x6aad9d01, blocks: 0x4800 00000100:00080000:0.0:1789762818.000420:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762818.000423:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762818.000443:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=120s v=(0 0) 00010000:00010000:1.0:1789762818.000448:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762818.000454:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762818.000468:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762818.006555:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00002000:00010000:3.0:1789762818.006640:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:3.0:1789762818.006647:0:6916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762817 -> 1789762818 00002000:00010000:3.0:1789762818.006650:0:6916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762817 -> 1789762818 00002000:00010000:3.0:1789762818.006653:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 18432 -> 20480 00010000:00010000:3.0:1789762818.006668:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.006681:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.006689:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.006705:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762818.006710:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.006716:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.006731:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.006736:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5986f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762818.006834:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246507264:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6527us (198045us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789762818.006842:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:3.0:1789762818.006848:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120437378385 time 120437521671 state 0x2 ref 0 00000100:00100000:0.0:1789762818.009217:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762818.009271:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507392 00000100:00100000:2.0:1789762818.009281:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507392 00000100:00100000:2.0:1789762818.009328:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120437378385 time 120437521671 state 0x0 ref 1 00000100:00100000:2.0:1789762818.009343:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120637521671 time 120437521671 state 0x1 ref 1 00000100:00100000:2.0:1789762818.200355:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120637521671 time 120637585040 state 0x0 ref 1 00000100:00100000:2.0:1789762818.200397:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246507392:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762818.200469:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 10485760, mtime: 0x6aad9d02, atime: 0x6aad9d00, ctime: 0x6aad9d02, blocks: 0x5000 00010000:00010000:2.0:1789762818.200478:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.200495:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=120s v=(0 0) 00010000:00010000:2.0:1789762818.200500:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762818.200517:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.200532:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762818.206271:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00002000:00010000:2.0:1789762818.206361:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:2.0:1789762818.206366:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 20480 -> 22528 00010000:00010000:2.0:1789762818.206375:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.206384:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.206390:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.206396:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762818.206400:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.206408:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.206424:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.206429:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59876 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762818.206492:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246507392:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6116us (197277us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789762818.206534:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:2.0:1789762818.206541:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120637521671 time 120637585040 state 0x2 ref 0 00000100:00100000:0.0:1789762818.208605:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762818.208675:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507520 00000100:00100000:3.0:1789762818.208687:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507520 00000100:00100000:3.0:1789762818.208736:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120637521671 time 120637585040 state 0x0 ref 1 00000100:00100000:3.0:1789762818.208777:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120837585040 time 120637585040 state 0x1 ref 1 00000100:00100000:3.0:1789762818.400414:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120837585040 time 120837651220 state 0x0 ref 1 00000100:00100000:3.0:1789762818.400442:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246507520:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762818.400517:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 11534336, mtime: 0x6aad9d02, atime: 0x6aad9d00, ctime: 0x6aad9d02, blocks: 0x5800 00010000:00010000:3.0:1789762818.400525:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.400540:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=120s v=(0 0) 00010000:00010000:3.0:1789762818.400544:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762818.400549:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.400561:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762818.406055:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00002000:00010000:3.0:1789762818.406128:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:3.0:1789762818.406134:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 22528 -> 24576 00010000:00010000:3.0:1789762818.406143:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.406152:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.406158:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.406163:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762818.406167:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.406184:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.406197:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.406202:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b5987d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762818.406256:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246507520:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5826us (197656us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789762818.406265:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:3.0:1789762818.406271:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120837585040 time 120837651220 state 0x2 ref 0 00000100:00100000:1.0:1789762818.408708:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762818.408778:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507648 00000100:00100000:3.0:1789762818.408786:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507648 00000100:00100000:3.0:1789762818.408814:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 120837585040 time 120837651220 state 0x0 ref 1 00000100:00100000:3.0:1789762818.408823:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121037651220 time 120837651220 state 0x1 ref 1 00000100:00100000:2.0:1789762818.435816:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762818.435873:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507776 00000100:00100000:0.0:1789762818.435884:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507776 00000100:00100000:2.0:1789762818.435895:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762818.435930:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 221 00000100:00100000:0.0:1789762818.435947:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246507776:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762818.435965:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762818.435985:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246507904 00000100:00100000:1.0:1789762818.435993:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246507904 00000100:00100000:3.0:1789762818.436009:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508160 00000100:00100000:0.0:1789762818.436011:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246507776:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762818.436016:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508160 00000100:00100000:0.0:1789762818.436020:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 221 00000100:00100000:2.0:1789762818.436032:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762818.436088:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508032 00000100:00100000:3.0:1789762818.436089:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1789762818.436100:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508032 00000100:00100000:0.0:1789762818.436104:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762818.436108:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246508160:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762818.436109:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:1.0:1789762818.436130:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+56:2353:x1876702246507904:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762818.436157:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762818.436162:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246508160:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 61us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762818.436176:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+56:2353:x1876702246507904:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762818.436196:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00080000:0.0:1789762818.436197:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762818.436198:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508416 00000100:00080000:0.0:1789762818.436205:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762818.436206:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:2.0:1789762818.436208:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508416 00000100:00100000:3.0:1789762818.436235:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508288 00000100:00100000:3.0:1789762818.436241:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508288 00000100:00100000:0.0:1789762818.436250:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00080000:1.0:1789762818.436257:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762818.436261:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762818.436268:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2354:x1876702246508032:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762818.436312:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1789762818.436321:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2354:x1876702246508032:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 54us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762818.436327:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:2.0:1789762818.436339:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246508416:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762818.436353:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246508288:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762818.436354:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:1.0:1789762818.436389:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246508288:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762818.436400:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:2.0:1789762818.436426:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246508416:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762818.436439:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:3.0:1789762818.600488:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121037651220 time 121037726685 state 0x0 ref 1 00000100:00100000:3.0:1789762818.600531:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246507648:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762818.600583:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 12582912, mtime: 0x6aad9d02, atime: 0x6aad9d00, ctime: 0x6aad9d02, blocks: 0x6000 00010000:00010000:3.0:1789762818.600591:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.600608:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=121s v=(0 0) 00010000:00010000:3.0:1789762818.600613:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762818.600620:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762818.600638:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762818.606831:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00002000:00010000:2.0:1789762818.606935:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:2.0:1789762818.606941:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:2.0:1789762818.606955:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.606967:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.606975:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.606991:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762818.606995:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.607003:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.607023:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.607028:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b59884 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762818.607122:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246507648:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6615us (198410us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789762818.607134:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:2.0:1789762818.607143:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121037651220 time 121037726685 state 0x2 ref 0 00000100:00100000:3.0:1789762818.609646:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762818.609691:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508544 00000100:00100000:2.0:1789762818.609705:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508544 00000100:00100000:2.0:1789762818.609781:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121037651220 time 121037726685 state 0x0 ref 1 00000100:00100000:2.0:1789762818.609793:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121237726685 time 121037726685 state 0x1 ref 1 00000100:00100000:2.0:1789762818.800593:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121237726685 time 121237827093 state 0x0 ref 1 00000100:00100000:2.0:1789762818.800633:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246508544:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762818.800722:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13631488, mtime: 0x6aad9d02, atime: 0x6aad9d00, ctime: 0x6aad9d02, blocks: 0x6800 00010000:00010000:2.0:1789762818.800732:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.800778:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=121s v=(0 0) 00010000:00010000:2.0:1789762818.800783:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762818.800790:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.800805:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762818.807259:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00002000:00010000:2.0:1789762818.807373:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:2.0:1789762818.807378:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 26624 -> 28672 00010000:00010000:2.0:1789762818.807389:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.807399:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.807406:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.807412:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762818.807416:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.807434:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.807451:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762818.807457:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5988b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762818.807537:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246508544:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6923us (197895us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789762818.807545:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:2.0:1789762818.807552:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121237726685 time 121237827093 state 0x2 ref 0 00000100:00100000:0.0:1789762818.809935:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762818.810002:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508672 00000100:00100000:3.0:1789762818.810012:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508672 00000100:00100000:3.0:1789762818.810051:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121237726685 time 121237827093 state 0x0 ref 1 00000100:00100000:3.0:1789762818.810062:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121437827093 time 121237827093 state 0x1 ref 1 00010000:00010000:2.0:1789762818.938931:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762819.000709:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121437827093 time 121437935778 state 0x0 ref 1 00000100:00100000:2.0:1789762819.000771:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246508672:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762819.000837:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 14680064, mtime: 0x6aad9d02, atime: 0x6aad9d00, ctime: 0x6aad9d02, blocks: 0x7000 00010000:00010000:2.0:1789762819.000847:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.000866:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=121s v=(0 0) 00010000:00010000:2.0:1789762819.000870:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762819.000876:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.000909:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762819.006692:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00002000:00010000:2.0:1789762819.006818:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:2.0:1789762819.006824:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762818 -> 1789762819 00002000:00010000:2.0:1789762819.006827:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762818 -> 1789762819 00002000:00010000:2.0:1789762819.006830:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 28672 -> 30720 00010000:00010000:2.0:1789762819.006842:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.006856:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.006867:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.006877:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762819.006884:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.006895:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.006918:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.006940:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59892 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.007014:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246508672:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6283us (197079us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789762819.007025:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:2.0:1789762819.007033:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121437827093 time 121437935778 state 0x2 ref 0 00000100:00100000:3.0:1789762819.009368:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762819.009406:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508800 00000100:00100000:2.0:1789762819.009415:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508800 00000100:00100000:2.0:1789762819.009452:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121437827093 time 121437935778 state 0x0 ref 1 00000100:00100000:2.0:1789762819.009462:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121637935778 time 121437935778 state 0x1 ref 1 00000100:00100000:2.0:1789762819.200834:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121637935778 time 121638066325 state 0x0 ref 1 00000100:00100000:2.0:1789762819.200882:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246508800:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762819.200962:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 15728640, mtime: 0x6aad9d03, atime: 0x6aad9d00, ctime: 0x6aad9d03, blocks: 0x7800 00010000:00010000:2.0:1789762819.200974:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.200995:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=121s v=(0 0) 00010000:00010000:2.0:1789762819.201000:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762819.201008:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.201051:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762819.207439:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00002000:00010000:2.0:1789762819.207559:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:2.0:1789762819.207565:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 30720 -> 32768 00010000:00010000:2.0:1789762819.207575:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.207585:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.207592:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.207598:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762819.207602:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.207610:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.207625:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.207630:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59899 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.207707:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246508800:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6850us (198341us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789762819.207716:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1789762819.207723:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121637935778 time 121638066325 state 0x2 ref 0 00000100:00100000:1.0:1789762819.209993:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762819.210035:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246508928 00000100:00100000:2.0:1789762819.210046:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246508928 00000100:00100000:2.0:1789762819.210085:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121637935778 time 121638066325 state 0x0 ref 1 00000100:00100000:2.0:1789762819.210096:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121838066325 time 121638066325 state 0x1 ref 1 00000004:00080000:1.0:1789762819.388007:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:1.0:1789762819.388027:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000004:00080000:1.0:1789762819.388054:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1789762819.388057:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1789762819.388107:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789762819.388156:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789762819.388157:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762819.388180:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254898688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762819.388180:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254898944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789762819.388227:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789762819.388243:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254899072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762819.388259:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762819.388306:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762819.388348:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898944 00000100:00100000:2.0:1789762819.388349:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254898816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762819.388363:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898944 00000100:00100000:1.0:1789762819.388364:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762819.388371:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254899072 00000100:00100000:0.0:1789762819.388378:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254899072 00000100:00100000:2.0:1789762819.388399:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762819.388443:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898688 00000100:00100000:2.0:1789762819.388447:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898688 00000100:00100000:0.0:1789762819.388457:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254898816 00000100:00100000:0.0:1789762819.388462:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254898816 00000100:00100000:3.0:1789762819.388485:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789762819.388515:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789762819.388523:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254899072:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762819.388535:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3418:x1876702254898944:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762819.388535:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789762819.388556:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254898688:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789762819.388566:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762819.388571:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789762819.388571:0:6911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00080000:2.0:1789762819.388574:0:6909:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00080000:1.0:1789762819.388584:0:7959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00010000:00010000:3.0:1789762819.388620:0:6911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762819.388624:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x4000 00002000:00010000:2.0:1789762819.388624:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad9cfd, atime: 0x6aad9cfd, ctime: 0x6aad9cfd, blocks: 0x0 00010000:00010000:1.0:1789762819.388645:0:7959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.388646:0:6909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.388680:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 8 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.388682:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=121s v=(0 0) 00010000:00010000:2.0:1789762819.388682:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=121s v=(0 0) 00010000:00010000:1.0:1789762819.388698:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762819.388702:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762819.388715:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.388724:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.388745:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 8 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.388786:0:7959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.388804:0:6909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.388832:0:7959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.388842:0:6909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.388844:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.388845:0:7959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.388888:0:6909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.388905:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789762819.388912:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762819.388918:0:7959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789762819.388919:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.388928:0:6909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789762819.388979:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.388981:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789762819.388994:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389004:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762819.389008:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389049:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.389067:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 8 pid: 6911 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389069:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.389091:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3419:x1876702254898688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 535us (721us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789762819.389096:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3418:x1876702254898944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 564us (832us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789762819.389128:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789762819.389130:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017f59308/0x5915dfb1c1b598a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762819.389138:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789762819.389144:0:6911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254899200:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762819.389157:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00010000:00010000:0.0:1789762819.389160:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789762819.389173:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3418:x1876702254898816:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789762819.389177:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789762819.389185:0:6909:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789762819.389190:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762819.389197:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762819.389199:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x4000 00010000:00010000:2.0:1789762819.389209:0:6909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389214:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.389217:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=121s v=(0 0) 00010000:00010000:2.0:1789762819.389225:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762819.389234:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389240:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389264:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b598ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.389268:0:6909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389278:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762819.389281:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762819.389284:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762819.389285:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 8 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.389286:0:6909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389304:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789762819.389335:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c3a5f100/2, rc 0, transno 4294967311 00010000:00010000:2.0:1789762819.389336:0:6909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.389348:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254898688:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789762819.389350:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 8 pid: 12136 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.389360:0:6909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762819.389378:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789762819.389381:0:6911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254899328:192.168.203.36@tcp:104: 00010000:00010000:0.0:1789762819.389384:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389397:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762819.389410:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389419:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389431:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.389437:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c918535e/0x5915dfb1c1b598b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.389455:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3418:x1876702254898816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (1055us total) trans 4294967313 rc 0/0 00010000:00010000:0.0:1789762819.389456:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762819.389460:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762819.389463:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762819.389464:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000004:00080000:0.0:1789762819.389489:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c3a5ca80/2, rc 0, transno 4294967312 00000100:00100000:0.0:1789762819.389512:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254898944:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789762819.389524:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c3a5ce00/2, rc 0, transno 4294967313 00000100:00100000:0.0:1789762819.389527:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254898816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789762819.389606:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 8 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.389649:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 8 pid: 6912 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762819.389659:0:6911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3cc4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254899456:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762819.389694:0:6911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f769fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789762819.390863:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762819.390897:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509056 00000100:00100000:0.0:1789762819.390902:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509056 00000100:00100000:3.0:1789762819.390932:0:6911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254899200:192.168.203.36@tcp:104: 00010000:00010000:0.0:1789762819.390933:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 9 pid: 6911 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.390960:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:0.0:1789762819.390967:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246509056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762819.390986:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762819.390991:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 9 pid: 6911 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.391003:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 9 pid: 6911 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.391018:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59677 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444ff expref: 9 pid: 6911 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.391029:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762819.391065:0:6911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254899328:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762819.391074:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246509056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762819.391087:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762819.391089:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:0.0:1789762819.391107:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509184 00000100:00100000:0.0:1789762819.391110:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509184 00010000:00010000:0.0:1789762819.391124:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 8 pid: 6912 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.391144:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:0.0:1789762819.391156:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246509184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789762819.391164:0:6911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3cc4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254899456:192.168.203.36@tcp:104: 00010000:00010000:0.0:1789762819.391170:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762819.391178:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 8 pid: 6912 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.391194:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 8 pid: 6912 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.391208:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1789762819.391229:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7658fd/0x5915dfb1c1b59670 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f1 expref: 8 pid: 6912 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.391246:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762819.391247:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509312 00000100:00100000:1.0:1789762819.391254:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509312 00010000:00010000:1.0:1789762819.391277:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 8 pid: 12136 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.391282:0:6911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.391290:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246509184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762819.391309:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:0.0:1789762819.391328:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:2.0:1789762819.391338:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246509312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762819.391351:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762819.391359:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 7 pid: 12136 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.391377:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 7 pid: 12136 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.391397:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b5967e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789444f8 expref: 7 pid: 12136 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.391423:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762819.391427:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762819.391431:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.391439:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762819.391462:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762819.391483:0:6911:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.391491:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246509312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 164us (284us total) trans 0 rc 0/0 00010000:00010000:0.0:1789762819.391504:0:6911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.391520:0:6911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762819.391522:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00010000:00010000:0.0:1789762819.391532:0:6911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.391547:0:6911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762819.391569:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762819.391584:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.391595:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762819.391600:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.391612:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.391626:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.391632:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009baebdcb/0x5915dfb1c1b598a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.391651:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762819.391653:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762819.391655:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762819.391670:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254899072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3173us (3367us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789762819.391676:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1789762819.391698:0:3420:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b33f47f9500/2, rc 0, transno 4294967328 00000100:00100000:2.0:1789762819.391711:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f47f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254899072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762819.400881:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121838066325 time 121838123781 state 0x0 ref 1 00000100:00100000:1.0:1789762819.400895:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246508928:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762819.400921:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 16777216, mtime: 0x6aad9d03, atime: 0x6aad9d00, ctime: 0x6aad9d03, blocks: 0x8000 00010000:00010000:1.0:1789762819.400926:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.400934:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=121s v=(0 0) 00010000:00010000:1.0:1789762819.400943:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762819.400947:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.400955:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762819.406186:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000001:00080000:3.0:1789762819.406201:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00002000:00010000:1.0:1789762819.406318:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:1.0:1789762819.406323:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 32768 -> 34816 00010000:00010000:1.0:1789762819.406330:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.406339:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.406344:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.406349:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762819.406351:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.406358:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.406366:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.406382:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b598bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762819.406431:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246508928:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5539us (196441us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789762819.406437:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:1.0:1789762819.406441:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121838066325 time 121838123781 state 0x2 ref 0 00000100:00100000:3.0:1789762819.408479:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762819.408543:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509440 00000100:00100000:2.0:1789762819.408549:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509440 00000100:00100000:2.0:1789762819.408575:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 121838066325 time 121838123781 state 0x0 ref 1 00000100:00100000:2.0:1789762819.408583:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122038123781 time 121838123781 state 0x1 ref 1 00000100:00100000:3.0:1789762819.601034:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122038123781 time 122038263995 state 0x0 ref 1 00000100:00100000:3.0:1789762819.601082:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246509440:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762819.601168:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 17825792, mtime: 0x6aad9d03, atime: 0x6aad9d00, ctime: 0x6aad9d03, blocks: 0x8800 00010000:00010000:3.0:1789762819.601187:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.601205:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=122s v=(0 0) 00010000:00010000:3.0:1789762819.601209:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762819.601215:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.601236:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762819.608164:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00002000:00010000:0.0:1789762819.608275:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:0.0:1789762819.608280:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 34816 -> 36864 00010000:00010000:0.0:1789762819.608298:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.608309:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.608316:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.608321:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762819.608325:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.608333:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.608349:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762819.608354:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174ec9cc/0x5915dfb1c1b598c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762819.608426:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246509440:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7366us (199944us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789762819.608437:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:0.0:1789762819.608446:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122038123781 time 122038263995 state 0x2 ref 0 00000100:00100000:3.0:1789762819.610585:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762819.610672:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509568 00000100:00100000:2.0:1789762819.610681:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509568 00000100:00100000:2.0:1789762819.610719:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122038123781 time 122038263995 state 0x0 ref 1 00000100:00100000:2.0:1789762819.610729:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122238263995 time 122038263995 state 0x1 ref 1 00000100:00100000:3.0:1789762819.801130:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122238263995 time 122238367285 state 0x0 ref 1 00000100:00100000:3.0:1789762819.801159:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246509568:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762819.801223:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 18874368, mtime: 0x6aad9d03, atime: 0x6aad9d00, ctime: 0x6aad9d03, blocks: 0x9000 00010000:00010000:3.0:1789762819.801231:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.801245:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=122s v=(0 0) 00010000:00010000:3.0:1789762819.801248:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762819.801254:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762819.801270:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762819.806799:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00002000:00010000:1.0:1789762819.806864:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:1.0:1789762819.806870:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 36864 -> 38912 00010000:00010000:1.0:1789762819.806879:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.806888:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.806895:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.806900:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762819.806903:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.806910:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.806934:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762819.806940:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dbee8fe/0x5915dfb1c1b598ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762819.806993:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246509568:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5847us (196408us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789762819.807000:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:1.0:1789762819.807006:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122238263995 time 122238367285 state 0x2 ref 0 00000100:00100000:3.0:1789762819.809076:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762819.809130:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509696 00000100:00100000:1.0:1789762819.809138:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509696 00000100:00100000:1.0:1789762819.809173:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122238263995 time 122238367285 state 0x0 ref 1 00000100:00100000:1.0:1789762819.809182:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122438367285 time 122238367285 state 0x1 ref 1 00000004:00080000:1.0:1789762819.898895:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 122336141937ns, next at 123336139069ns, rc = 0 00000100:00100000:2.0:1789762819.898895:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c212aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254899584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762819.898966:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762819.899011:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254899584 00000100:00100000:1.0:1789762819.899019:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254899584 00000100:00100000:1.0:1789762819.899068:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789762819.899078:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254899584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762819.899099:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 182223424 pending 0 free 3894308864 avail 3655274496 00000100:00100000:1.0:1789762819.899144:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254899584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762819.899151:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789762819.899174:0:3420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:2.0:1789762819.899182:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b33f47f9500, transno 4294967328 00000100:00100000:2.0:1789762819.899209:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c212aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254899584:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789762819.904433:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789762819.904448:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1789762819.962895:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762820.001249:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122438367285 time 122438489158 state 0x0 ref 1 00000100:00100000:3.0:1789762820.001287:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246509696:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:0.0:1789762820.001331:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762820.001350:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 19922944, mtime: 0x6aad9d03, atime: 0x6aad9d00, ctime: 0x6aad9d03, blocks: 0x9800 00010000:00010000:3.0:1789762820.001362:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.001378:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=122s v=(0 0) 00010000:00010000:3.0:1789762820.001382:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762820.001387:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.001419:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762820.006817:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00002000:00010000:0.0:1789762820.006902:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:0.0:1789762820.006908:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762819 -> 1789762820 00002000:00010000:0.0:1789762820.006911:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762819 -> 1789762820 00002000:00010000:0.0:1789762820.006915:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 38912 -> 40960 00010000:00010000:0.0:1789762820.006926:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.006938:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.006948:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.006957:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762820.006962:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.006972:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.006990:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.006999:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce4f10d3/0x5915dfb1c1b598d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.007058:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246509696:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5795us (197982us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789762820.007073:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:0.0:1789762820.007078:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122438367285 time 122438489158 state 0x2 ref 0 00000100:00100000:3.0:1789762820.009216:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762820.009287:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509824 00000100:00100000:0.0:1789762820.009296:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509824 00000100:00100000:0.0:1789762820.009327:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122438367285 time 122438489158 state 0x0 ref 1 00000100:00100000:0.0:1789762820.009336:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122638489158 time 122438489158 state 0x1 ref 1 00000100:00100000:0.0:1789762820.201313:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122638489158 time 122638552508 state 0x0 ref 1 00000100:00100000:0.0:1789762820.201342:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246509824:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762820.201390:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 20971520, mtime: 0x6aad9d04, atime: 0x6aad9d00, ctime: 0x6aad9d04, blocks: 0xa000 00010000:00010000:0.0:1789762820.201398:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.201413:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=122s v=(0 0) 00010000:00010000:0.0:1789762820.201416:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762820.201429:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.201442:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762820.206702:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00002000:00010000:0.0:1789762820.206812:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:0.0:1789762820.206817:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 40960 -> 43008 00010000:00010000:0.0:1789762820.206825:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.206840:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.206848:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.206853:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762820.206857:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.206863:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.206875:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.206880:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b598d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.206933:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246509824:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5604us (197717us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789762820.206940:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:0.0:1789762820.206944:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122638489158 time 122638552508 state 0x2 ref 0 00000100:00100000:3.0:1789762820.209066:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762820.209117:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246509952 00000100:00100000:1.0:1789762820.209124:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246509952 00000100:00100000:1.0:1789762820.209156:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122638489158 time 122638552508 state 0x0 ref 1 00000100:00100000:1.0:1789762820.209164:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122838552508 time 122638552508 state 0x1 ref 1 00000100:00100000:2.0:1789762820.401426:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122838552508 time 122838661601 state 0x0 ref 1 00000100:00100000:2.0:1789762820.401459:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246509952:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762820.401527:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 22020096, mtime: 0x6aad9d04, atime: 0x6aad9d00, ctime: 0x6aad9d04, blocks: 0xa800 00010000:00010000:2.0:1789762820.401537:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.401554:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=122s v=(0 0) 00010000:00010000:2.0:1789762820.401558:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762820.401565:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.401579:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762820.407410:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00002000:00010000:2.0:1789762820.407499:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:2.0:1789762820.407505:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 43008 -> 45056 00010000:00010000:2.0:1789762820.407516:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.407540:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.407549:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.407557:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762820.407561:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.407571:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.407588:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.407596:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762820.407656:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246509952:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6211us (198589us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789762820.407666:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1789762820.407674:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122838552508 time 122838661601 state 0x2 ref 0 00000100:00100000:1.0:1789762820.409857:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762820.409939:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510080 00000100:00100000:0.0:1789762820.409952:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510080 00000100:00100000:0.0:1789762820.409982:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 122838552508 time 122838661601 state 0x0 ref 1 00000100:00100000:0.0:1789762820.409993:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123038661601 time 122838661601 state 0x1 ref 1 00000100:00100000:2.0:1789762820.601582:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123038661601 time 123038821441 state 0x0 ref 1 00000100:00100000:2.0:1789762820.601622:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510080:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762820.601671:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 23068672, mtime: 0x6aad9d04, atime: 0x6aad9d00, ctime: 0x6aad9d04, blocks: 0xb000 00010000:00010000:2.0:1789762820.601679:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.601693:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=123s v=(0 0) 00010000:00010000:2.0:1789762820.601696:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762820.601701:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.601714:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762820.606733:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00002000:00010000:2.0:1789762820.606820:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:2.0:1789762820.606826:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 45056 -> 47104 00010000:00010000:2.0:1789762820.606836:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.606847:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.606856:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.606863:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762820.606868:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.606884:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.606901:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762820.606909:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b598e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762820.606969:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510080:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5355us (197111us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789762820.606979:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:2.0:1789762820.606986:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123038661601 time 123038821441 state 0x2 ref 0 00000100:00100000:3.0:1789762820.609118:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762820.609163:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510208 00000100:00100000:0.0:1789762820.609171:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510208 00000100:00100000:0.0:1789762820.609203:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123038661601 time 123038821441 state 0x0 ref 1 00000100:00100000:0.0:1789762820.609212:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123238821441 time 123038821441 state 0x1 ref 1 00000100:00100000:3.0:1789762820.801688:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123238821441 time 123238925795 state 0x0 ref 1 00000100:00100000:3.0:1789762820.801717:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246510208:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762820.801795:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 24117248, mtime: 0x6aad9d04, atime: 0x6aad9d00, ctime: 0x6aad9d04, blocks: 0xb800 00010000:00010000:3.0:1789762820.801803:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.801821:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=123s v=(0 0) 00010000:00010000:3.0:1789762820.801826:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762820.801833:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762820.801851:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762820.807313:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00002000:00010000:0.0:1789762820.807374:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:0.0:1789762820.807379:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 47104 -> 49152 00010000:00010000:0.0:1789762820.807387:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.807396:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.807405:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.807413:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762820.807418:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.807428:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.807446:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762820.807461:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f70d7f3c/0x5915dfb1c1b598ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762820.807529:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246510208:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5825us (198411us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789762820.807536:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:0.0:1789762820.807542:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123238821441 time 123238925795 state 0x2 ref 0 00000100:00100000:3.0:1789762820.809792:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762820.809830:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510336 00000100:00100000:0.0:1789762820.809839:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510336 00000100:00100000:0.0:1789762820.809878:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123238821441 time 123238925795 state 0x0 ref 1 00000100:00100000:0.0:1789762820.809890:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123438925795 time 123238925795 state 0x1 ref 1 00010000:00010000:0.0:1789762820.986905:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762821.001791:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123438925795 time 123439030858 state 0x0 ref 1 00000100:00100000:3.0:1789762821.001818:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246510336:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762821.001863:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 25165824, mtime: 0x6aad9d04, atime: 0x6aad9d00, ctime: 0x6aad9d04, blocks: 0xc000 00010000:00010000:3.0:1789762821.001871:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762821.001885:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=123s v=(0 0) 00010000:00010000:3.0:1789762821.001890:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762821.001894:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762821.001904:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762821.007380:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00002000:00010000:0.0:1789762821.007508:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:0.0:1789762821.007512:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762820 -> 1789762821 00002000:00010000:0.0:1789762821.007515:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762820 -> 1789762821 00002000:00010000:0.0:1789762821.007516:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 49152 -> 51200 00010000:00010000:0.0:1789762821.007525:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.007534:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.007540:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.007552:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762821.007556:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.007564:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.007577:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.007582:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c5c8aef/0x5915dfb1c1b598f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762821.007633:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246510336:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5827us (197843us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789762821.007641:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:0.0:1789762821.007646:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123438925795 time 123439030858 state 0x2 ref 0 00000100:00100000:3.0:1789762821.009927:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762821.009968:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510464 00000100:00100000:2.0:1789762821.009976:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510464 00000100:00100000:2.0:1789762821.010010:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123438925795 time 123439030858 state 0x0 ref 1 00000100:00100000:2.0:1789762821.010019:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123639030858 time 123439030858 state 0x1 ref 1 00000100:00100000:1.0:1789762821.201878:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123639030858 time 123639115518 state 0x0 ref 1 00000100:00100000:1.0:1789762821.201907:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510464:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762821.201964:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 26214400, mtime: 0x6aad9d05, atime: 0x6aad9d00, ctime: 0x6aad9d05, blocks: 0xc800 00010000:00010000:1.0:1789762821.201975:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.201998:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=123s v=(0 0) 00010000:00010000:1.0:1789762821.202001:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762821.202006:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.202018:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762821.207358:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00002000:00010000:1.0:1789762821.207471:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:1.0:1789762821.207477:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 51200 -> 53248 00010000:00010000:1.0:1789762821.207501:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.207510:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.207523:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.207528:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762821.207532:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.207539:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.207553:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762821.207562:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b598fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762821.207626:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510464:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5732us (197700us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789762821.207635:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1789762821.207640:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123639030858 time 123639115518 state 0x2 ref 0 00000100:00100000:3.0:1789762821.209960:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762821.210015:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510592 00000100:00100000:0.0:1789762821.210023:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510592 00000100:00100000:0.0:1789762821.210056:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123639030858 time 123639115518 state 0x0 ref 1 00000100:00100000:0.0:1789762821.210080:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123839115518 time 123639115518 state 0x1 ref 1 00000100:00100000:3.0:1789762821.401990:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123839115518 time 123839225740 state 0x0 ref 1 00000100:00100000:3.0:1789762821.402028:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246510592:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762821.402079:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 27262976, mtime: 0x6aad9d05, atime: 0x6aad9d00, ctime: 0x6aad9d05, blocks: 0xd000 00010000:00010000:3.0:1789762821.402098:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762821.402112:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=123s v=(0 0) 00010000:00010000:3.0:1789762821.402115:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762821.402120:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762821.402131:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762821.407132:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00002000:00010000:0.0:1789762821.407207:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:0.0:1789762821.407212:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 53248 -> 55296 00010000:00010000:0.0:1789762821.407227:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.407236:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.407242:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.407247:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762821.407251:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.407258:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.407271:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.407276:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433bddc1/0x5915dfb1c1b59902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762821.407332:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246510592:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5322us (197372us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789762821.407341:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:0.0:1789762821.407347:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123839115518 time 123839225740 state 0x2 ref 0 00000100:00100000:3.0:1789762821.409569:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762821.409610:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510720 00000100:00100000:0.0:1789762821.409624:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510720 00000100:00100000:0.0:1789762821.409654:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 123839115518 time 123839225740 state 0x0 ref 1 00000100:00100000:0.0:1789762821.409663:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124039225740 time 123839225740 state 0x1 ref 1 00000100:00100000:0.0:1789762821.602085:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124039225740 time 124039320415 state 0x0 ref 1 00000100:00100000:0.0:1789762821.602118:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510720:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762821.602175:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 28311552, mtime: 0x6aad9d05, atime: 0x6aad9d00, ctime: 0x6aad9d05, blocks: 0xd800 00010000:00010000:0.0:1789762821.602183:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.602197:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=124s v=(0 0) 00010000:00010000:0.0:1789762821.602201:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762821.602206:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.602219:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762821.607564:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00002000:00010000:0.0:1789762821.607630:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:0.0:1789762821.607636:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 55296 -> 57344 00010000:00010000:0.0:1789762821.607645:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.607653:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.607669:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.607675:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762821.607679:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.607685:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.607699:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762821.607705:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762821.607805:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510720:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5702us (198235us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789762821.607812:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1789762821.607818:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124039225740 time 124039320415 state 0x2 ref 0 00000100:00100000:3.0:1789762821.609942:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762821.609981:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510848 00000100:00100000:1.0:1789762821.609989:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510848 00000100:00100000:1.0:1789762821.610022:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124039225740 time 124039320415 state 0x0 ref 1 00000100:00100000:1.0:1789762821.610030:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124239320415 time 124039320415 state 0x1 ref 1 00000100:00100000:2.0:1789762821.802204:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124239320415 time 124239440676 state 0x0 ref 1 00000100:00100000:2.0:1789762821.802237:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246510848:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762821.802295:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 29360128, mtime: 0x6aad9d05, atime: 0x6aad9d00, ctime: 0x6aad9d05, blocks: 0xe000 00010000:00010000:2.0:1789762821.802305:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.802337:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=124s v=(0 0) 00010000:00010000:2.0:1789762821.802342:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762821.802349:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.802364:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762821.808317:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00002000:00010000:2.0:1789762821.808398:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:2.0:1789762821.808404:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 57344 -> 59392 00010000:00010000:2.0:1789762821.808413:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.808425:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.808435:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.808443:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762821.808449:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.808458:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.808501:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762821.808511:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762821.808576:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246510848:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6353us (198631us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789762821.808586:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:2.0:1789762821.808594:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124239320415 time 124239440676 state 0x2 ref 0 00000100:00100000:3.0:1789762821.810860:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762821.810920:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246510976 00000100:00100000:0.0:1789762821.810930:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246510976 00000100:00100000:0.0:1789762821.810969:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124239320415 time 124239440676 state 0x0 ref 1 00000100:00100000:0.0:1789762821.810981:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124439440676 time 124239440676 state 0x1 ref 1 00000100:00100000:2.0:1789762822.002327:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124439440676 time 124439562690 state 0x0 ref 1 00000100:00100000:2.0:1789762822.002376:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510976:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:0.0:1789762822.002396:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762822.002434:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 30408704, mtime: 0x6aad9d05, atime: 0x6aad9d00, ctime: 0x6aad9d05, blocks: 0xe800 00010000:00010000:2.0:1789762822.002445:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.002461:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=124s v=(0 0) 00010000:00010000:2.0:1789762822.002466:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762822.002473:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.002501:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762822.008232:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00002000:00010000:2.0:1789762822.008315:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:2.0:1789762822.008321:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762821 -> 1789762822 00002000:00010000:2.0:1789762822.008324:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762821 -> 1789762822 00002000:00010000:2.0:1789762822.008326:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 59392 -> 61440 00010000:00010000:2.0:1789762822.008336:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.008347:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.008356:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.008363:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762822.008367:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.008377:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.008394:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.008403:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b59917 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762822.008492:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246510976:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6129us (197619us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789762822.008504:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:2.0:1789762822.008512:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124439440676 time 124439562690 state 0x2 ref 0 00000100:00100000:3.0:1789762822.010645:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762822.010694:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246511104 00000100:00100000:0.0:1789762822.010702:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246511104 00000100:00100000:0.0:1789762822.010737:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124439440676 time 124439562690 state 0x0 ref 1 00000100:00100000:0.0:1789762822.010746:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124639562690 time 124439562690 state 0x1 ref 1 00010000:00010000:0.0:1789762822.010877:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762822.202377:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124639562690 time 124639615981 state 0x0 ref 1 00000100:00100000:0.0:1789762822.202412:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511104:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762822.202460:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 31457280, mtime: 0x6aad9d06, atime: 0x6aad9d00, ctime: 0x6aad9d06, blocks: 0xf000 00010000:00010000:0.0:1789762822.202468:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.202494:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=124s v=(0 0) 00010000:00010000:0.0:1789762822.202497:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762822.202503:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.202514:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762822.207900:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00002000:00010000:0.0:1789762822.207968:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789762822.207973:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 61440 -> 63488 00010000:00010000:0.0:1789762822.207984:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.208009:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.208020:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.208029:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762822.208033:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.208041:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.208059:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.208070:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5991e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762822.208126:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511104:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5732us (197481us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789762822.208133:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:0.0:1789762822.208139:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124639562690 time 124639615981 state 0x2 ref 0 00000100:00100000:1.0:1789762822.210519:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762822.210571:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246511232 00000100:00100000:2.0:1789762822.210579:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246511232 00000100:00100000:2.0:1789762822.210614:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124639562690 time 124639615981 state 0x0 ref 1 00000100:00100000:2.0:1789762822.210626:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124839615981 time 124639615981 state 0x1 ref 1 00000100:00100000:3.0:1789762822.402552:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124839615981 time 124839783016 state 0x0 ref 1 00000100:00100000:3.0:1789762822.402580:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246511232:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762822.402629:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 32505856, mtime: 0x6aad9d06, atime: 0x6aad9d00, ctime: 0x6aad9d06, blocks: 0xf800 00010000:00010000:3.0:1789762822.402637:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.402666:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=124s v=(0 0) 00010000:00010000:3.0:1789762822.402670:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762822.402675:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.402686:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762822.408205:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00002000:00010000:3.0:1789762822.408284:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:3.0:1789762822.408289:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 63488 -> 65536 00010000:00010000:3.0:1789762822.408299:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.408308:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.408315:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.408320:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762822.408324:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.408330:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.408356:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.408362:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762822.408422:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246511232:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5853us (197902us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789762822.408430:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:3.0:1789762822.408437:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124839615981 time 124839783016 state 0x2 ref 0 00000100:00100000:1.0:1789762822.410772:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762822.410849:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246511360 00000100:00100000:2.0:1789762822.410859:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246511360 00000100:00100000:2.0:1789762822.410894:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 124839615981 time 124839783016 state 0x0 ref 1 00000100:00100000:2.0:1789762822.410903:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125039783016 time 124839783016 state 0x1 ref 1 00000100:00100000:2.0:1789762822.602623:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125039783016 time 125039861603 state 0x0 ref 1 00000100:00100000:2.0:1789762822.602652:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511360:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762822.602700:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 33554432, mtime: 0x6aad9d06, atime: 0x6aad9d00, ctime: 0x6aad9d06, blocks: 0x10000 00010000:00010000:2.0:1789762822.602707:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.602721:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=125s v=(0 0) 00010000:00010000:2.0:1789762822.602725:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762822.602730:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762822.602795:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762822.607709:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00002000:00010000:3.0:1789762822.607783:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:3.0:1789762822.607789:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 65536 -> 67584 00010000:00010000:3.0:1789762822.607798:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.607806:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.607813:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.607818:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762822.607822:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.607838:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.607852:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762822.607857:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5992c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762822.607906:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511360:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5268us (197160us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789762822.607914:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:3.0:1789762822.607919:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125039783016 time 125039861603 state 0x2 ref 0 00000100:00100000:1.0:1789762822.610066:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762822.610114:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246511488 00000100:00100000:0.0:1789762822.610122:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246511488 00000100:00100000:0.0:1789762822.610160:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125039783016 time 125039861603 state 0x0 ref 1 00000100:00100000:0.0:1789762822.610169:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125239861603 time 125039861603 state 0x1 ref 1 00000100:00100000:0.0:1789762822.802692:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125239861603 time 125239930896 state 0x0 ref 1 00000100:00100000:0.0:1789762822.802722:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246511488:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762822.802798:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 34603008, mtime: 0x6aad9d06, atime: 0x6aad9d00, ctime: 0x6aad9d06, blocks: 0x10800 00010000:00010000:0.0:1789762822.802807:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.802822:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=125s v=(0 0) 00010000:00010000:0.0:1789762822.802825:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762822.802830:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.802841:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762822.807921:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00002000:00010000:0.0:1789762822.807991:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:0.0:1789762822.807996:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 67584 -> 69632 00010000:00010000:0.0:1789762822.808006:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.808015:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.808027:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.808033:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762822.808036:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.808042:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.808055:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762822.808061:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762822.808111:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246511488:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5402us (198045us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789762822.808118:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:0.0:1789762822.808124:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125239861603 time 125239930896 state 0x2 ref 0 00000100:00100000:2.0:1789762822.810306:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762822.810345:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246511616 00000100:00100000:3.0:1789762822.810352:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246511616 00000100:00100000:3.0:1789762822.810381:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125239861603 time 125239930896 state 0x0 ref 1 00000100:00100000:3.0:1789762822.810389:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125439930896 time 125239930896 state 0x1 ref 1 00000100:00100000:3.0:1789762822.970937:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254899712:0@lo:400:kworker.0 00000100:00100000:0.0:1789762822.970940:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762822.970940:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254899968:0@lo:400:kworker.0 00000100:00100000:1.0:1789762822.970978:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c238b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254900096:0@lo:400:kworker.0 00000100:00100000:3.0:1789762822.971034:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762822.971037:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762822.971038:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762822.971085:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254899712 00000100:00100000:1.0:1789762822.971098:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254899712 00000100:00100000:2.0:1789762822.971113:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254900352:0@lo:400:kworker.0 00000100:00100000:0.0:1789762822.971116:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c238b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254900480:0@lo:400:kworker.0 00000100:00100000:3.0:1789762822.971116:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254900224:0@lo:400:kworker.0 00000100:00100000:1.0:1789762822.971143:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789762822.971148:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762822.971159:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762822.971161:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762822.971182:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254899968 00000100:00100000:2.0:1789762822.971187:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900352 00000100:00100000:3.0:1789762822.971187:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254899968 00000100:00100000:2.0:1789762822.971192:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900352 00000100:00100000:1.0:1789762822.971215:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254899712:12345-0@lo:400:kworker.0 Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00080000:2.0:1789762822.971216:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762822.971225:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789762822.971228:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254899840 00000100:00100000:0.0:1789762822.971235:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254899840 00000100:00100000:3.0:1789762822.971237:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789762822.971247:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254899968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762822.971273:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900480 00000100:00080000:2.0:1789762822.971276:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762822.971278:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900480 00000100:00100000:0.0:1789762822.971298:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789762822.971303:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789762822.971306:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254899968:12345-0@lo:400:kworker.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762822.971310:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254899840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762822.971316:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789762822.971319:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789762822.971320:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254900352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762822.971330:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254900480:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789762822.971337:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50758208 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762822.971355:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762822.971386:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254900352:12345-0@lo:400:kworker.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762822.971388:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254900480:12345-0@lo:400:kworker.0 Request processed in 61us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762822.971398:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254899840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762822.971398:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900096 00000100:00100000:1.0:1789762822.971403:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789762822.971403:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789762822.971414:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789762822.971415:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900096 00000100:00100000:0.0:1789762822.971448:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789762822.971448:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762822.971459:0:3419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000100:00100000:3.0:1789762822.971459:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1789762822.971465:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c3a5f100, transno 4294967311 00000100:00100000:3.0:1789762822.971488:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254900096:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1789762822.971491:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c3a5ca80, transno 4294967312 00000004:00080000:1.0:1789762822.971496:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c3a5ce00, transno 4294967313 00000100:00100000:2.0:1789762822.971499:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254900352:0@lo:400:kworker.0 00000100:00100000:1.0:1789762822.971504:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c238b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254900480:0@lo:400:kworker.0 00000100:00100000:0.0:1789762822.971508:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254899712:0@lo:400:kworker.0 00000100:00100000:2.0:1789762822.971526:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254899968:0@lo:400:kworker.0 00000100:00100000:3.0:1789762822.971538:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254900096:12345-0@lo:400:kworker.0 Request processed in 66us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762822.971539:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762822.971553:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789762822.971580:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900224 00000100:00100000:1.0:1789762822.971590:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900224 00000100:00100000:3.0:1789762822.971593:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c238b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254900096:0@lo:400:kworker.0 00000100:00080000:2.0:1789762822.971620:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762822.971631:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789762822.971638:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254900224:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1789762822.971648:0:8697:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1789762822.971670:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254900224:12345-0@lo:400:kworker.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762822.971679:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789762822.971695:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254900224:0@lo:400:kworker.0 00000100:00100000:0.0:1789762823.002799:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125439930896 time 125440038520 state 0x0 ref 1 00000100:00100000:0.0:1789762823.002821:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511616:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762823.002860:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 35651584, mtime: 0x6aad9d06, atime: 0x6aad9d00, ctime: 0x6aad9d06, blocks: 0x11000 00010000:00010000:0.0:1789762823.002867:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.002880:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=125s v=(0 0) 00010000:00010000:0.0:1789762823.002884:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762823.002889:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.002899:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762823.008064:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00002000:00010000:0.0:1789762823.008135:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:0.0:1789762823.008141:0:12138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762822 -> 1789762823 00002000:00010000:0.0:1789762823.008144:0:12138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762822 -> 1789762823 00002000:00010000:0.0:1789762823.008147:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 69632 -> 71680 00010000:00010000:0.0:1789762823.008158:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.008171:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.008182:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.008189:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762823.008195:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.008206:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.008223:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.008233:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b5993a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762823.008295:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511616:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5480us (197990us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789762823.008302:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:0.0:1789762823.008307:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125439930896 time 125440038520 state 0x2 ref 0 00000100:00100000:1.0:1789762823.010526:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762823.010566:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246511744 00000100:00100000:3.0:1789762823.010573:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246511744 00000100:00100000:3.0:1789762823.010602:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125439930896 time 125440038520 state 0x0 ref 1 00000100:00100000:3.0:1789762823.010611:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125640038520 time 125440038520 state 0x1 ref 1 00010000:00010000:1.0:1789762823.034848:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762823.202910:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125640038520 time 125640145826 state 0x0 ref 1 00000100:00100000:2.0:1789762823.202952:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246511744:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762823.203018:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 36700160, mtime: 0x6aad9d07, atime: 0x6aad9d00, ctime: 0x6aad9d07, blocks: 0x11800 00010000:00010000:2.0:1789762823.203025:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.203038:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=125s v=(0 0) 00010000:00010000:2.0:1789762823.203042:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762823.203049:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.203065:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762823.208093:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00002000:00010000:0.0:1789762823.208181:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:0.0:1789762823.208186:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 71680 -> 73728 00010000:00010000:0.0:1789762823.208195:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.208204:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.208210:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.208215:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762823.208218:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.208225:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.208239:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.208254:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b59941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762823.208307:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246511744:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5379us (197781us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789762823.208314:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:0.0:1789762823.208319:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125640038520 time 125640145826 state 0x2 ref 0 00000100:00100000:1.0:1789762823.210837:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762823.210876:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246511872 00000100:00100000:0.0:1789762823.210883:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246511872 00000100:00100000:0.0:1789762823.210916:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125640038520 time 125640145826 state 0x0 ref 1 00000100:00100000:0.0:1789762823.210925:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125840145826 time 125640145826 state 0x1 ref 1 00000100:00100000:2.0:1789762823.403007:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125840145826 time 125840242473 state 0x0 ref 1 00000100:00100000:2.0:1789762823.403050:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511872:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762823.403109:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 37748736, mtime: 0x6aad9d07, atime: 0x6aad9d00, ctime: 0x6aad9d07, blocks: 0x12000 00010000:00010000:2.0:1789762823.403129:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.403147:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=125s v=(0 0) 00010000:00010000:2.0:1789762823.403152:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762823.403158:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.403174:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762823.408377:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00002000:00010000:2.0:1789762823.408493:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:2.0:1789762823.408497:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 73728 -> 75776 00010000:00010000:2.0:1789762823.408506:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.408515:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.408522:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.408527:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762823.408530:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.408537:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.408551:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762823.408555:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b59948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762823.408611:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246511872:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5586us (197774us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789762823.408626:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:2.0:1789762823.408631:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125840145826 time 125840242473 state 0x2 ref 0 00000100:00100000:1.0:1789762823.410890:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762823.410935:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512000 00000100:00100000:0.0:1789762823.410943:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512000 00000100:00100000:0.0:1789762823.410977:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 125840145826 time 125840242473 state 0x0 ref 1 00000100:00100000:0.0:1789762823.410990:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126040242473 time 125840242473 state 0x1 ref 1 00000100:00100000:3.0:1789762823.555963:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762823.556004:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762823.556036:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512128 00000100:00100000:3.0:1789762823.556042:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762823.556048:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512128 00000100:00100000:1.0:1789762823.556069:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512384 00000100:00100000:1.0:1789762823.556076:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512384 00000100:00100000:3.0:1789762823.556081:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762823.556105:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512256 00000100:00100000:0.0:1789762823.556107:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:3.0:1789762823.556109:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512512 00000100:00100000:2.0:1789762823.556113:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512256 00000100:00100000:3.0:1789762823.556116:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512512 00000100:00100000:0.0:1789762823.556121:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2353:x1876702246512128:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762823.556130:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:1.0:1789762823.556142:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246512384:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762823.556157:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:2.0:1789762823.556166:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246512256:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762823.556173:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1789762823.556182:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2353:x1876702246512128:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762823.556188:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246512384:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762823.556202:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:3.0:1789762823.556204:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246512512:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762823.556212:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246512256:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762823.556215:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:2.0:1789762823.556228:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00080000:1.0:1789762823.556236:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762823.556243:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762823.556246:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246512512:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762823.556254:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:1.0:1789762823.559431:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762823.559456:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762823.559498:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512640 00000100:00100000:3.0:1789762823.559503:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512640 00000100:00100000:0.0:1789762823.559508:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512768 00000100:00100000:0.0:1789762823.559515:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512768 00000100:00100000:3.0:1789762823.559548:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00080000:1.0:1789762823.559550:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762823.559558:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00080000:1.0:1789762823.559558:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762823.559563:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2352:x1876702246512640:12345-192.168.203.36@tcp:9:kworker.0 00000100:00100000:0.0:1789762823.559573:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2352:x1876702246512768:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:3.0:1789762823.559582:0:6909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5915dfb1c1b59264 00000020:00000080:0.0:1789762823.559588:0:12136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5915dfb1c1b5926b 00000100:00080000:0.0:1789762823.559596:0:12136:0:(import.c:65:import_set_state_nolock()) ffff9b33f726a000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789762823.559597:0:6909:0:(import.c:65:import_set_state_nolock()) ffff9b33f7508800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789762823.559632:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789762823.559645:0:12136:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967313 00010000:00010000:1.0:1789762823.559645:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789762823.559652:0:6909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967349 00000100:00100000:0.0:1789762823.559804:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+2:2352:x1876702246512768:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 235us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762823.559805:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+2:2352:x1876702246512640:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 248us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762823.559817:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:3.0:1789762823.559824:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:0.0:1789762823.603072:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126040242473 time 126040306593 state 0x0 ref 1 00000100:00100000:0.0:1789762823.603092:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246512000:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762823.603132:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 38797312, mtime: 0x6aad9d07, atime: 0x6aad9d00, ctime: 0x6aad9d07, blocks: 0x12800 00010000:00010000:0.0:1789762823.603140:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.603161:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=126s v=(0 0) 00010000:00010000:0.0:1789762823.603165:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762823.603169:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.603181:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762823.607831:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000001:00100000:2.0:1789762823.607838:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16ee4165-0fa4-42d2-b611-78faaebc19a7 00000020:00000080:2.0:1789762823.607841:0:6905:0:(genops.c:885:class_export_put()) final put ffff9b33f750f000/16ee4165-0fa4-42d2-b611-78faaebc19a7 00000020:00000080:1.0:1789762823.607919:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b33f750f000/16ee4165-0fa4-42d2-b611-78faaebc19a7 for lustre-OST0000 00002000:00010000:0.0:1789762823.607936:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:0.0:1789762823.607942:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 75776 -> 77824 00010000:00010000:0.0:1789762823.607950:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.607959:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789762823.607966:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b33f7508800 for lustre-OST0000 00010000:00010000:0.0:1789762823.607967:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.607975:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762823.607979:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.607986:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.607999:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762823.608004:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ed4e57e/0x5915dfb1c1b5994f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762823.608057:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246512000:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4972us (197168us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789762823.608071:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:0.0:1789762823.608077:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126040242473 time 126040306593 state 0x2 ref 0 00000100:00100000:1.0:1789762823.610070:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762823.610104:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246512896 00000100:00100000:0.0:1789762823.610111:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246512896 00000100:00100000:0.0:1789762823.610145:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126040242473 time 126040306593 state 0x0 ref 1 00000100:00100000:0.0:1789762823.610154:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126240306593 time 126040306593 state 0x1 ref 1 00000100:00100000:3.0:1789762823.803172:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126240306593 time 126240409931 state 0x0 ref 1 00000100:00100000:3.0:1789762823.803201:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246512896:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762823.803249:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 39845888, mtime: 0x6aad9d07, atime: 0x6aad9d00, ctime: 0x6aad9d07, blocks: 0x13000 00010000:00010000:3.0:1789762823.803256:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.803270:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=126s v=(0 0) 00010000:00010000:3.0:1789762823.803274:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762823.803278:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.803308:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762823.808554:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00002000:00010000:3.0:1789762823.808660:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:3.0:1789762823.808665:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 77824 -> 79872 00010000:00010000:3.0:1789762823.808674:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.808683:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.808689:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.808694:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762823.808697:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.808705:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.808717:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762823.808722:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762823.808810:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246512896:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5620us (198738us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789762823.808820:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:3.0:1789762823.808827:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126240306593 time 126240409931 state 0x2 ref 0 00000100:00100000:2.0:1789762823.811020:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762823.811070:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513024 00000100:00100000:0.0:1789762823.811080:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513024 00000100:00100000:0.0:1789762823.811113:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126240306593 time 126240409931 state 0x0 ref 1 00000100:00100000:0.0:1789762823.811123:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126440409931 time 126240409931 state 0x1 ref 1 00000100:00100000:3.0:1789762824.003269:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126440409931 time 126440507301 state 0x0 ref 1 00000100:00100000:3.0:1789762824.003305:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513024:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:1.0:1789762824.003333:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762824.003354:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 40894464, mtime: 0x6aad9d07, atime: 0x6aad9d00, ctime: 0x6aad9d07, blocks: 0x13800 00010000:00010000:3.0:1789762824.003362:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.003375:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=126s v=(0 0) 00010000:00010000:3.0:1789762824.003378:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762824.003383:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.003394:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762824.008526:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00002000:00010000:3.0:1789762824.008591:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:3.0:1789762824.008595:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762823 -> 1789762824 00002000:00010000:3.0:1789762824.008597:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762823 -> 1789762824 00002000:00010000:3.0:1789762824.008599:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 79872 -> 81920 00010000:00010000:3.0:1789762824.008607:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.008622:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.008629:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.008635:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762824.008638:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.008645:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.008657:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.008662:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5995d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762824.008711:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513024:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5427us (197691us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789762824.008719:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:3.0:1789762824.008725:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126440409931 time 126440507301 state 0x2 ref 0 00000100:00100000:0.0:1789762824.010959:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762824.010992:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513152 00000100:00100000:3.0:1789762824.011005:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513152 00000100:00100000:3.0:1789762824.011035:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126440409931 time 126440507301 state 0x0 ref 1 00000100:00100000:3.0:1789762824.011044:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126640507301 time 126440507301 state 0x1 ref 1 00010000:00010000:0.0:1789762824.058886:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762824.203349:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126640507301 time 126640585205 state 0x0 ref 1 00000100:00100000:3.0:1789762824.203381:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513152:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762824.203433:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 41943040, mtime: 0x6aad9d08, atime: 0x6aad9d00, ctime: 0x6aad9d08, blocks: 0x14000 00010000:00010000:3.0:1789762824.203443:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.203475:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=126s v=(0 0) 00010000:00010000:3.0:1789762824.203481:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762824.203489:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.203504:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762824.209308:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00002000:00010000:3.0:1789762824.209392:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789762824.209398:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 81920 -> 83968 00010000:00010000:3.0:1789762824.209408:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.209418:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.209441:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.209450:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762824.209455:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.209484:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.209502:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.209511:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762824.209573:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513152:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6204us (198613us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789762824.209584:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:3.0:1789762824.209591:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126640507301 time 126640585205 state 0x2 ref 0 00000100:00100000:0.0:1789762824.211852:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762824.211891:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513280 00000100:00100000:3.0:1789762824.211900:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513280 00000100:00100000:3.0:1789762824.211936:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126640507301 time 126640585205 state 0x0 ref 1 00000100:00100000:3.0:1789762824.211948:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126840585205 time 126640585205 state 0x1 ref 1 00000100:00100000:2.0:1789762824.403510:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126840585205 time 126840748046 state 0x0 ref 1 00000100:00100000:2.0:1789762824.403545:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513280:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762824.403593:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 42991616, mtime: 0x6aad9d08, atime: 0x6aad9d00, ctime: 0x6aad9d08, blocks: 0x14800 00010000:00010000:2.0:1789762824.403601:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762824.403614:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=126s v=(0 0) 00010000:00010000:2.0:1789762824.403632:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762824.403637:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762824.403649:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762824.408833:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00002000:00010000:3.0:1789762824.408897:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:3.0:1789762824.408902:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 83968 -> 86016 00010000:00010000:3.0:1789762824.408910:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.408919:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.408926:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.408930:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762824.408934:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.408941:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.408953:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762824.408958:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5996b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762824.409010:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513280:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5485us (197159us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789762824.409026:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:3.0:1789762824.409031:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126840585205 time 126840748046 state 0x2 ref 0 00000100:00100000:1.0:1789762824.411280:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762824.411315:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513408 00000100:00100000:3.0:1789762824.411322:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513408 00000100:00100000:3.0:1789762824.411351:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 126840585205 time 126840748046 state 0x0 ref 1 00000100:00100000:3.0:1789762824.411360:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127040748046 time 126840748046 state 0x1 ref 1 00000100:00100000:0.0:1789762824.603643:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127040748046 time 127040880436 state 0x0 ref 1 00000100:00100000:0.0:1789762824.603672:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513408:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762824.603718:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 44040192, mtime: 0x6aad9d08, atime: 0x6aad9d00, ctime: 0x6aad9d08, blocks: 0x15000 00010000:00010000:0.0:1789762824.603726:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.603740:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=127s v=(0 0) 00010000:00010000:0.0:1789762824.603744:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762824.603748:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.603819:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762824.609337:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00002000:00010000:1.0:1789762824.609415:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:1.0:1789762824.609422:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 86016 -> 88064 00010000:00010000:1.0:1789762824.609433:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762824.609442:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762824.609448:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762824.609453:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762824.609468:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762824.609476:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762824.609492:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762824.609497:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045defd49/0x5915dfb1c1b59972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762824.609552:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513408:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5893us (198273us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789762824.609569:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:1.0:1789762824.609575:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127040748046 time 127040880436 state 0x2 ref 0 00000100:00100000:2.0:1789762824.611776:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762824.611828:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513536 00000100:00100000:3.0:1789762824.611837:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513536 00000100:00100000:3.0:1789762824.611874:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127040748046 time 127040880436 state 0x0 ref 1 00000100:00100000:3.0:1789762824.611888:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127240880436 time 127040880436 state 0x1 ref 1 00000100:00100000:0.0:1789762824.803802:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127240880436 time 127241039780 state 0x0 ref 1 00000100:00100000:0.0:1789762824.803834:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513536:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762824.803888:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 45088768, mtime: 0x6aad9d08, atime: 0x6aad9d00, ctime: 0x6aad9d08, blocks: 0x15800 00010000:00010000:0.0:1789762824.803899:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.803917:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=127s v=(0 0) 00010000:00010000:0.0:1789762824.803922:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762824.803929:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.803944:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762824.809774:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00002000:00010000:0.0:1789762824.809841:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1789762824.809846:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 88064 -> 90112 00010000:00010000:0.0:1789762824.809853:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.809862:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.809878:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.809883:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762824.809886:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.809893:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.809906:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762824.809911:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59979 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762824.809964:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513536:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6144us (198211us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789762824.809971:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:0.0:1789762824.809977:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127240880436 time 127241039780 state 0x2 ref 0 00000100:00100000:2.0:1789762824.812085:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762824.812124:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513664 00000100:00100000:3.0:1789762824.812132:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513664 00000100:00100000:3.0:1789762824.812164:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127240880436 time 127241039780 state 0x0 ref 1 00000100:00100000:3.0:1789762824.812173:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127441039780 time 127241039780 state 0x1 ref 1 00000100:00100000:0.0:1789762825.003978:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127441039780 time 127441213540 state 0x0 ref 1 00000100:00100000:0.0:1789762825.004012:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513664:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762825.004061:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 46137344, mtime: 0x6aad9d08, atime: 0x6aad9d00, ctime: 0x6aad9d08, blocks: 0x16000 00010000:00010000:0.0:1789762825.004082:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.004096:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=127s v=(0 0) 00010000:00010000:0.0:1789762825.004101:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762825.004108:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.004122:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762825.009529:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00002000:00010000:0.0:1789762825.009602:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:0.0:1789762825.009606:0:6916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762824 -> 1789762825 00002000:00010000:0.0:1789762825.009609:0:6916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762824 -> 1789762825 00002000:00010000:0.0:1789762825.009610:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 90112 -> 92160 00010000:00010000:0.0:1789762825.009619:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.009628:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.009635:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.009640:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762825.009644:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.009660:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.009674:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.009679:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b59980 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762825.009733:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513664:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5735us (197648us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789762825.009740:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:0.0:1789762825.009745:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127441039780 time 127441213540 state 0x2 ref 0 00000100:00100000:1.0:1789762825.011803:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762825.011836:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513792 00000100:00100000:0.0:1789762825.011845:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513792 00000100:00100000:0.0:1789762825.011875:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127441039780 time 127441213540 state 0x0 ref 1 00000100:00100000:0.0:1789762825.011884:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127641213540 time 127441213540 state 0x1 ref 1 00000004:00080000:2.0:1789762825.018874:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 127456121411ns, next at 128456118096ns, rc = 0 00000100:00100000:0.0:1789762825.018887:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789762825.018904:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f74a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254900608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762825.018957:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762825.018993:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900608 00000100:00100000:3.0:1789762825.018999:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900608 00000100:00080000:1.0:1789762825.019038:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762825.019045:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789762825.019055:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254900608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762825.019072:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 365265472 pending 0 free 3871240192 avail 3636498432 00000100:00100000:3.0:1789762825.019112:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254900608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762825.019118:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789762825.019162:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f74a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254900608:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789762825.019572:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789762825.019586:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1789762825.019658:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789762825.019671:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254900736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762825.019700:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762825.019795:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900736 00000100:00100000:1.0:1789762825.019801:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900736 00000100:00100000:1.0:1789762825.019832:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789762825.019839:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254900736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762825.019855:0:6912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789762825.019871:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad9cff, atime: 0x6aad9cff, ctime: 0x6aad9cff, blocks: 0x4000 00010000:00010000:1.0:1789762825.019876:0:6912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762825.019886:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=127s v=(0 0) 00010000:00010000:1.0:1789762825.019889:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762825.019893:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762825.019902:0:6912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762825.019908:0:6912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762825.019914:0:6912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762825.019934:0:6912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762825.019945:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762825.019952:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762825.019960:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762825.019964:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762825.019971:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762825.019994:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762825.020000:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59987 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762825.020015:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762825.020016:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762825.020019:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762825.020039:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254900736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 199us (336us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1789762825.020046:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:3.0:1789762825.020071:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c3cc7b80/2, rc 0, transno 4294967358 00000100:00100000:3.0:1789762825.020077:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254900736:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789762825.082900:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762825.204029:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127641213540 time 127641266273 state 0x0 ref 1 00000100:00100000:0.0:1789762825.204069:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513792:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762825.204120:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 47185920, mtime: 0x6aad9d09, atime: 0x6aad9d00, ctime: 0x6aad9d09, blocks: 0x16800 00010000:00010000:0.0:1789762825.204130:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.204147:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=127s v=(0 0) 00010000:00010000:0.0:1789762825.204152:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762825.204159:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.204174:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762825.209341:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00000001:00080000:3.0:1789762825.209350:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00002000:00010000:0.0:1789762825.209415:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:0.0:1789762825.209420:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 92160 -> 94208 00010000:00010000:0.0:1789762825.209429:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.209438:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.209445:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.209466:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762825.209470:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.209483:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.209496:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762825.209501:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7972448/0x5915dfb1c1b5998e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762825.209550:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246513792:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5490us (197749us total) trans 4294967359 rc 0/0 00000100:00100000:0.0:1789762825.209557:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:0.0:1789762825.209561:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127641213540 time 127641266273 state 0x2 ref 0 00000100:00100000:1.0:1789762825.211771:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762825.211796:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246513920 00000100:00100000:0.0:1789762825.211804:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246513920 00000100:00100000:0.0:1789762825.211834:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127641213540 time 127641266273 state 0x0 ref 1 00000100:00100000:0.0:1789762825.211842:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127841266273 time 127641266273 state 0x1 ref 1 00000100:00100000:2.0:1789762825.404136:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127841266273 time 127841371833 state 0x0 ref 1 00000100:00100000:2.0:1789762825.404171:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513920:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762825.404220:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 48234496, mtime: 0x6aad9d09, atime: 0x6aad9d00, ctime: 0x6aad9d09, blocks: 0x17000 00010000:00010000:2.0:1789762825.404228:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762825.404242:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=127s v=(0 0) 00010000:00010000:2.0:1789762825.404254:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762825.404258:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762825.404269:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762825.409687:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00002000:00010000:3.0:1789762825.409769:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789762825.409775:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 94208 -> 96256 00010000:00010000:3.0:1789762825.409783:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.409793:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.409800:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.409805:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762825.409809:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.409816:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.409829:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.409834:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b59995 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762825.409904:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246513920:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5749us (198153us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789762825.409912:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:3.0:1789762825.409917:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127841266273 time 127841371833 state 0x2 ref 0 00000100:00100000:1.0:1789762825.411981:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762825.412034:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514048 00000100:00100000:0.0:1789762825.412044:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514048 00000100:00100000:0.0:1789762825.412083:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 127841266273 time 127841371833 state 0x0 ref 1 00000100:00100000:0.0:1789762825.412094:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128041371833 time 127841371833 state 0x1 ref 1 00000001:00100000:2.0:1789762825.531881:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16ee4165-0fa4-42d2-b611-78faaebc19a7 00000020:00000080:2.0:1789762825.531888:0:7983:0:(genops.c:885:class_export_put()) final put ffff9b33f726b000/16ee4165-0fa4-42d2-b611-78faaebc19a7 00000020:00000080:1.0:1789762825.531927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b33f726b000/16ee4165-0fa4-42d2-b611-78faaebc19a7 for lustre-OST0001 00000020:00000080:1.0:1789762825.531971:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b33f726a000 for lustre-OST0001 00000100:00100000:3.0:1789762825.604240:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128041371833 time 128041473253 state 0x0 ref 1 00000100:00100000:3.0:1789762825.604268:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514048:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762825.604316:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 49283072, mtime: 0x6aad9d09, atime: 0x6aad9d00, ctime: 0x6aad9d09, blocks: 0x17800 00010000:00010000:3.0:1789762825.604323:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.604337:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=128s v=(0 0) 00010000:00010000:3.0:1789762825.604341:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762825.604345:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.604358:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762825.610206:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00002000:00010000:3.0:1789762825.610302:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:3.0:1789762825.610307:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 96256 -> 98304 00010000:00010000:3.0:1789762825.610316:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.610335:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.610341:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.610345:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762825.610349:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.610355:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.610368:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.610373:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b5999c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762825.610425:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514048:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6169us (198446us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1789762825.610433:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:3.0:1789762825.610438:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128041371833 time 128041473253 state 0x2 ref 0 00000100:00100000:1.0:1789762825.612710:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762825.612783:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514176 00000100:00100000:0.0:1789762825.612792:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514176 00000100:00100000:0.0:1789762825.612831:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128041371833 time 128041473253 state 0x0 ref 1 00000100:00100000:0.0:1789762825.612840:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128241473253 time 128041473253 state 0x1 ref 1 00000100:00100000:3.0:1789762825.804392:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128241473253 time 128241627747 state 0x0 ref 1 00000100:00100000:3.0:1789762825.804443:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514176:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762825.804505:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 50331648, mtime: 0x6aad9d09, atime: 0x6aad9d00, ctime: 0x6aad9d09, blocks: 0x18000 00010000:00010000:3.0:1789762825.804513:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.804527:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=128s v=(0 0) 00010000:00010000:3.0:1789762825.804531:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762825.804536:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.804546:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762825.810224:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00002000:00010000:3.0:1789762825.810293:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789762825.810298:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 98304 -> 100352 00010000:00010000:3.0:1789762825.810308:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.810316:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.810323:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.810328:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762825.810331:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.810343:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.810357:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762825.810362:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762825.810415:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514176:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5984us (197704us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789762825.810425:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:3.0:1789762825.810432:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128241473253 time 128241627747 state 0x2 ref 0 00000100:00100000:0.0:1789762825.812695:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762825.812733:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514304 00000100:00100000:3.0:1789762825.812742:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514304 00000100:00100000:3.0:1789762825.812801:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128241473253 time 128241627747 state 0x0 ref 1 00000100:00100000:3.0:1789762825.812810:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128441627747 time 128241627747 state 0x1 ref 1 00000100:00100000:1.0:1789762826.004520:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128441627747 time 128441757373 state 0x0 ref 1 00000100:00100000:1.0:1789762826.004566:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514304:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:2.0:1789762826.004605:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789762826.004617:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 51380224, mtime: 0x6aad9d09, atime: 0x6aad9d00, ctime: 0x6aad9d09, blocks: 0x18800 00010000:00010000:1.0:1789762826.004625:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762826.004639:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=128s v=(0 0) 00010000:00010000:1.0:1789762826.004643:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762826.004648:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762826.004659:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762826.009547:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00002000:00010000:0.0:1789762826.009637:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:0.0:1789762826.009642:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762825 -> 1789762826 00002000:00010000:0.0:1789762826.009644:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762825 -> 1789762826 00002000:00010000:0.0:1789762826.009646:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 100352 -> 102400 00010000:00010000:0.0:1789762826.009654:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.009662:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.009669:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.009674:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762826.009678:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.009684:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.009698:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.009714:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4f29a0e/0x5915dfb1c1b599aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762826.009792:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514304:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5255us (197096us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789762826.009800:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:0.0:1789762826.009806:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128441627747 time 128441757373 state 0x2 ref 0 00000100:00100000:2.0:1789762826.012273:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762826.012308:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514432 00000100:00100000:3.0:1789762826.012316:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514432 00000100:00100000:3.0:1789762826.012345:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128441627747 time 128441757373 state 0x0 ref 1 00000100:00100000:3.0:1789762826.012354:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128641757373 time 128441757373 state 0x1 ref 1 00010000:00010000:1.0:1789762826.106906:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762826.204617:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128641757373 time 128641855448 state 0x0 ref 1 00000100:00100000:2.0:1789762826.204646:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514432:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762826.204692:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 52428800, mtime: 0x6aad9d0a, atime: 0x6aad9d00, ctime: 0x6aad9d0a, blocks: 0x19000 00010000:00010000:2.0:1789762826.204700:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762826.204713:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=128s v=(0 0) 00010000:00010000:2.0:1789762826.204717:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762826.204721:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762826.204732:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762826.209840:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00002000:00010000:0.0:1789762826.209918:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:0.0:1789762826.209923:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 102400 -> 104448 00010000:00010000:0.0:1789762826.209932:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.209940:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.209946:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.209951:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762826.209954:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.209961:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.209985:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.209991:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b599b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762826.210042:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514432:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5410us (197772us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789762826.210049:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:0.0:1789762826.210054:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128641757373 time 128641855448 state 0x2 ref 0 00000100:00100000:1.0:1789762826.212668:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762826.212708:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514560 00000100:00100000:3.0:1789762826.212717:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514560 00000100:00100000:3.0:1789762826.212770:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128641757373 time 128641855448 state 0x0 ref 1 00000100:00100000:3.0:1789762826.212780:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128841855448 time 128641855448 state 0x1 ref 1 00000100:00100000:0.0:1789762826.404681:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128841855448 time 128841922847 state 0x0 ref 1 00000100:00100000:0.0:1789762826.404721:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514560:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762826.404841:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 53477376, mtime: 0x6aad9d0a, atime: 0x6aad9d00, ctime: 0x6aad9d0a, blocks: 0x19800 00010000:00010000:0.0:1789762826.404851:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.404867:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=128s v=(0 0) 00010000:00010000:0.0:1789762826.404871:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762826.404877:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.404890:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762826.410497:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00002000:00010000:3.0:1789762826.410562:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:3.0:1789762826.410567:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 104448 -> 106496 00010000:00010000:3.0:1789762826.410576:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.410585:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.410591:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.410596:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762826.410599:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.410606:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.410618:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.410623:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b599b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762826.410699:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514560:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6002us (198030us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789762826.410708:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:3.0:1789762826.410715:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128841855448 time 128841922847 state 0x2 ref 0 00000100:00100000:1.0:1789762826.413329:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762826.413365:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514688 00000100:00100000:0.0:1789762826.413374:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514688 00000100:00100000:0.0:1789762826.413403:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 128841855448 time 128841922847 state 0x0 ref 1 00000100:00100000:0.0:1789762826.413412:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129041922847 time 128841922847 state 0x1 ref 1 00000100:00100000:0.0:1789762826.604824:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129041922847 time 129042061343 state 0x0 ref 1 00000100:00100000:0.0:1789762826.604857:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514688:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762826.604912:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 54525952, mtime: 0x6aad9d0a, atime: 0x6aad9d00, ctime: 0x6aad9d0a, blocks: 0x1a000 00010000:00010000:0.0:1789762826.604921:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.604937:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=129s v=(0 0) 00010000:00010000:0.0:1789762826.604942:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762826.604948:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.604963:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762826.611320:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00002000:00010000:0.0:1789762826.611405:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:0.0:1789762826.611411:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 106496 -> 108544 00010000:00010000:0.0:1789762826.611422:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.611458:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.611469:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.611476:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762826.611481:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.611490:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.611508:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.611516:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762826.611581:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514688:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6737us (198250us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789762826.611592:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1789762826.611599:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129041922847 time 129042061343 state 0x2 ref 0 00000100:00100000:2.0:1789762826.613787:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762826.613824:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514816 00000100:00100000:0.0:1789762826.613838:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514816 00000100:00100000:0.0:1789762826.613872:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129041922847 time 129042061343 state 0x0 ref 1 00000100:00100000:0.0:1789762826.613884:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129242061343 time 129042061343 state 0x1 ref 1 00000100:00100000:0.0:1789762826.804878:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129242061343 time 129242117302 state 0x0 ref 1 00000100:00100000:0.0:1789762826.804907:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514816:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762826.804956:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 55574528, mtime: 0x6aad9d0a, atime: 0x6aad9d00, ctime: 0x6aad9d0a, blocks: 0x1a800 00010000:00010000:0.0:1789762826.804964:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.804978:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=129s v=(0 0) 00010000:00010000:0.0:1789762826.804982:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762826.804986:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762826.804998:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762826.809968:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00002000:00010000:3.0:1789762826.810069:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:3.0:1789762826.810074:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 108544 -> 110592 00010000:00010000:3.0:1789762826.810082:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.810091:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.810097:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.810102:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762826.810106:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.810113:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.810126:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762826.810142:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b599c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762826.810195:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246514816:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5303us (196410us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789762826.810201:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:3.0:1789762826.810206:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129242061343 time 129242117302 state 0x2 ref 0 00000100:00100000:1.0:1789762826.813134:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762826.813175:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246514944 00000100:00100000:3.0:1789762826.813187:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246514944 00000100:00100000:3.0:1789762826.813237:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129242061343 time 129242117302 state 0x0 ref 1 00000100:00100000:3.0:1789762826.813250:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129442117302 time 129242117302 state 0x1 ref 1 00000100:00100000:3.0:1789762827.004969:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129442117302 time 129442207320 state 0x0 ref 1 00000100:00100000:3.0:1789762827.004997:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514944:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762827.005047:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 56623104, mtime: 0x6aad9d0a, atime: 0x6aad9d00, ctime: 0x6aad9d0a, blocks: 0x1b000 00010000:00010000:3.0:1789762827.005056:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.005074:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=129s v=(0 0) 00010000:00010000:3.0:1789762827.005079:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762827.005086:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.005124:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762827.010207:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00002000:00010000:3.0:1789762827.010278:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:3.0:1789762827.010283:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762826 -> 1789762827 00002000:00010000:3.0:1789762827.010285:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762826 -> 1789762827 00002000:00010000:3.0:1789762827.010287:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 110592 -> 112640 00010000:00010000:3.0:1789762827.010296:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.010304:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.010311:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.010316:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762827.010319:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.010325:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.010339:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.010354:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762827.010424:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246514944:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5436us (197291us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789762827.010433:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:3.0:1789762827.010451:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129442117302 time 129442207320 state 0x2 ref 0 00000100:00100000:0.0:1789762827.012897:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762827.012933:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515072 00000100:00100000:3.0:1789762827.012941:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515072 00000100:00100000:3.0:1789762827.012974:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129442117302 time 129442207320 state 0x0 ref 1 00000100:00100000:3.0:1789762827.012983:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129642207320 time 129442207320 state 0x1 ref 1 00010000:00010000:0.0:1789762827.130932:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762827.205042:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129642207320 time 129642279995 state 0x0 ref 1 00000100:00100000:3.0:1789762827.205070:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515072:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762827.205119:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 57671680, mtime: 0x6aad9d0b, atime: 0x6aad9d00, ctime: 0x6aad9d0b, blocks: 0x1b800 00010000:00010000:3.0:1789762827.205126:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.205140:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=129s v=(0 0) 00010000:00010000:3.0:1789762827.205143:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762827.205148:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.205175:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762827.210628:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00002000:00010000:3.0:1789762827.210704:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:3.0:1789762827.210709:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 112640 -> 114688 00010000:00010000:3.0:1789762827.210717:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.210725:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.210731:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.210736:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762827.210739:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.210747:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.210777:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762827.210783:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762827.210841:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515072:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5783us (197943us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789762827.210848:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:3.0:1789762827.210854:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129642207320 time 129642279995 state 0x2 ref 0 00000100:00100000:2.0:1789762827.213026:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762827.213060:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515200 00000100:00100000:3.0:1789762827.213067:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515200 00000100:00100000:3.0:1789762827.213098:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129642207320 time 129642279995 state 0x0 ref 1 00000100:00100000:3.0:1789762827.213106:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129842279995 time 129642279995 state 0x1 ref 1 00000100:00100000:0.0:1789762827.405188:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129842279995 time 129842425340 state 0x0 ref 1 00000100:00100000:0.0:1789762827.405218:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515200:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762827.405267:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 58720256, mtime: 0x6aad9d0b, atime: 0x6aad9d00, ctime: 0x6aad9d0b, blocks: 0x1c000 00010000:00010000:0.0:1789762827.405275:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.405302:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=129s v=(0 0) 00010000:00010000:0.0:1789762827.405305:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762827.405310:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.405321:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762827.410726:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00002000:00010000:0.0:1789762827.410842:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:0.0:1789762827.410847:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 114688 -> 116736 00010000:00010000:0.0:1789762827.410857:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.410866:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.410875:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.410883:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762827.410888:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.410898:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.410932:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.410938:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762827.410997:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515200:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5792us (197970us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789762827.411005:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:0.0:1789762827.411011:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129842279995 time 129842425340 state 0x2 ref 0 00000100:00100000:1.0:1789762827.413470:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762827.413521:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515328 00000100:00100000:3.0:1789762827.413529:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515328 00000100:00100000:3.0:1789762827.413562:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 129842279995 time 129842425340 state 0x0 ref 1 00000100:00100000:3.0:1789762827.413571:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130042425340 time 129842425340 state 0x1 ref 1 00000100:00100000:0.0:1789762827.605271:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130042425340 time 130042511678 state 0x0 ref 1 00000100:00100000:0.0:1789762827.605296:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515328:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762827.605342:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 59768832, mtime: 0x6aad9d0b, atime: 0x6aad9d00, ctime: 0x6aad9d0b, blocks: 0x1c800 00010000:00010000:0.0:1789762827.605350:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.605372:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=130s v=(0 0) 00010000:00010000:0.0:1789762827.605376:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762827.605380:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.605393:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762827.610156:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00002000:00010000:0.0:1789762827.610222:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:0.0:1789762827.610228:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 116736 -> 118784 00010000:00010000:0.0:1789762827.610241:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.610255:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.610265:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.610273:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762827.610278:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.610286:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.610300:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.610305:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762827.610364:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515328:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5075us (196892us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789762827.610383:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:0.0:1789762827.610391:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130042425340 time 130042511678 state 0x2 ref 0 00000100:00100000:1.0:1789762827.612573:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762827.612616:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515456 00000100:00100000:3.0:1789762827.612625:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515456 00000100:00100000:3.0:1789762827.612659:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130042425340 time 130042511678 state 0x0 ref 1 00000100:00100000:3.0:1789762827.612668:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130242511678 time 130042511678 state 0x1 ref 1 00000100:00100000:0.0:1789762827.805359:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130242511678 time 130242596855 state 0x0 ref 1 00000100:00100000:0.0:1789762827.805389:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515456:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762827.805452:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 60817408, mtime: 0x6aad9d0b, atime: 0x6aad9d00, ctime: 0x6aad9d0b, blocks: 0x1d000 00010000:00010000:0.0:1789762827.805461:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.805475:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=130s v=(0 0) 00010000:00010000:0.0:1789762827.805479:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762827.805484:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.805495:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762827.810319:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00002000:00010000:0.0:1789762827.810390:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:0.0:1789762827.810397:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 118784 -> 120832 00010000:00010000:0.0:1789762827.810410:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.810425:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.810455:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.810460:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762827.810464:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.810471:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.810484:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762827.810489:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762827.810552:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515456:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5175us (197977us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789762827.810559:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:0.0:1789762827.810564:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130242511678 time 130242596855 state 0x2 ref 0 00000100:00100000:2.0:1789762827.812764:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762827.812799:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515584 00000100:00100000:0.0:1789762827.812807:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515584 00000100:00100000:0.0:1789762827.812840:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130242511678 time 130242596855 state 0x0 ref 1 00000100:00100000:0.0:1789762827.812849:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130442596855 time 130242596855 state 0x1 ref 1 00000100:00100000:0.0:1789762828.005418:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130442596855 time 130442655878 state 0x0 ref 1 00000100:00100000:0.0:1789762828.005472:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515584:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:2.0:1789762828.005510:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762828.005522:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 61865984, mtime: 0x6aad9d0b, atime: 0x6aad9d00, ctime: 0x6aad9d0b, blocks: 0x1d800 00010000:00010000:0.0:1789762828.005530:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.005542:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=130s v=(0 0) 00010000:00010000:0.0:1789762828.005546:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762828.005551:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.005561:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762828.010537:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00002000:00010000:0.0:1789762828.010597:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:0.0:1789762828.010601:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762827 -> 1789762828 00002000:00010000:0.0:1789762828.010603:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762827 -> 1789762828 00002000:00010000:0.0:1789762828.010605:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 120832 -> 122880 00010000:00010000:0.0:1789762828.010614:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.010623:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.010629:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.010641:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762828.010645:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.010652:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.010667:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.010674:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762828.010737:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515584:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5303us (197987us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789762828.010746:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:0.0:1789762828.010776:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130442596855 time 130442655878 state 0x2 ref 0 00000100:00100000:2.0:1789762828.012868:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762828.012904:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515712 00000100:00100000:0.0:1789762828.012911:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515712 00000100:00100000:0.0:1789762828.012943:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130442596855 time 130442655878 state 0x0 ref 1 00000100:00100000:0.0:1789762828.012953:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130642655878 time 130442655878 state 0x1 ref 1 00000100:00100000:1.0:1789762828.090889:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762828.090908:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c238b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254900864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762828.090909:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254900992:0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.090917:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789762828.090942:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254901376:0@lo:400:kworker.0 00000100:00100000:2.0:1789762828.090977:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254901120:0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.090989:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762828.090992:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762828.090999:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762828.091034:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762828.091070:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254901248:0@lo:400:kworker.0 00000100:00100000:2.0:1789762828.091071:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254901632:0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.091076:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254901504:0@lo:400:kworker.0 00000100:00100000:1.0:1789762828.091079:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900864 00000100:00100000:1.0:1789762828.091087:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900864 00000100:00100000:2.0:1789762828.091111:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762828.091123:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762828.091141:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254901376 00000100:00100000:0.0:1789762828.091146:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254901376 00000100:00100000:1.0:1789762828.091149:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789762828.091161:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254900864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762828.091174:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254901120 00000100:00100000:2.0:1789762828.091179:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254901120 00002000:00000024:1.0:1789762828.091186:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42320448 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762828.091191:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762828.091203:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254901632 00000100:00100000:0.0:1789762828.091207:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254901632 00000100:00100000:2.0:1789762828.091226:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254901248 00000100:00100000:2.0:1789762828.091230:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254901248 00000100:00100000:1.0:1789762828.091237:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254900864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762828.091244:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789762828.091247:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789762828.091257:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789762828.091260:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254901504 00000100:00100000:3.0:1789762828.091260:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254901376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762828.091265:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254901504 00000100:00100000:0.0:1789762828.091269:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254901632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762828.091282:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254900992 00000100:00100000:1.0:1789762828.091287:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254900992 00000100:00100000:2.0:1789762828.091296:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789762828.091306:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254901120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762828.091323:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789762828.091325:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254901632:12345-0@lo:400:kworker.0 Request processed in 56us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762828.091326:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254901376:12345-0@lo:400:kworker.0 Request processed in 67us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762828.091333:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254900992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762828.091340:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789762828.091347:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254901120:12345-0@lo:400:kworker.0 Request processed in 41us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762828.091348:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789762828.091358:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789762828.091381:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789762828.091388:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254900992:12345-0@lo:400:kworker.0 Request processed in 57us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762828.091392:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254901120:0@lo:400:kworker.0 00000100:00100000:2.0:1789762828.091396:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789762828.091398:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254901248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762828.091405:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789762828.091416:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254901632:0@lo:400:kworker.0 00000100:00100000:2.0:1789762828.091416:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254901504:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762828.091456:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762828.091461:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762828.091465:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762828.091466:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254901248:12345-0@lo:400:kworker.0 Request processed in 74us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762828.091480:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254901504:12345-0@lo:400:kworker.0 Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762828.091490:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789762828.091491:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254901504:0@lo:400:kworker.0 00000100:00100000:2.0:1789762828.091501:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789762828.091504:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c238b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254900864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762828.091511:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254900992:0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.091546:0:3418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967358 gen 2 00000004:00080000:3.0:1789762828.091553:0:3418:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c3cc7b80, transno 4294967358 00000100:00100000:3.0:1789762828.091566:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254901376:0@lo:400:kworker.0 00000100:00100000:3.0:1789762828.091578:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254901248:0@lo:400:kworker.0 00010000:00010000:2.0:1789762828.154892:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762828.205485:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130642655878 time 130642721577 state 0x0 ref 1 00000100:00100000:0.0:1789762828.205520:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515712:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762828.205573:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 62914560, mtime: 0x6aad9d0c, atime: 0x6aad9d00, ctime: 0x6aad9d0c, blocks: 0x1e000 00010000:00010000:0.0:1789762828.205580:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.205595:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=130s v=(0 0) 00010000:00010000:0.0:1789762828.205598:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762828.205603:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762828.205632:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762828.210388:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00002000:00010000:3.0:1789762828.210466:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:3.0:1789762828.210471:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 122880 -> 124928 00010000:00010000:3.0:1789762828.210480:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.210489:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.210496:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.210511:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762828.210515:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.210522:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.210536:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.210541:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b599f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762828.210598:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246515712:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5093us (197729us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789762828.210608:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:3.0:1789762828.210614:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130642655878 time 130642721577 state 0x2 ref 0 00000100:00100000:1.0:1789762828.212728:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762828.212777:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515840 00000100:00100000:0.0:1789762828.212785:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515840 00000100:00100000:0.0:1789762828.212818:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130642655878 time 130642721577 state 0x0 ref 1 00000100:00100000:0.0:1789762828.212827:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130842721577 time 130642721577 state 0x1 ref 1 00000100:00100000:3.0:1789762828.405595:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130842721577 time 130842833038 state 0x0 ref 1 00000100:00100000:3.0:1789762828.405624:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515840:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762828.405672:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 63963136, mtime: 0x6aad9d0c, atime: 0x6aad9d00, ctime: 0x6aad9d0c, blocks: 0x1e800 00010000:00010000:3.0:1789762828.405680:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.405712:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=130s v=(0 0) 00010000:00010000:3.0:1789762828.405716:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762828.405721:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.405733:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762828.411958:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00002000:00010000:3.0:1789762828.412037:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:3.0:1789762828.412043:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 124928 -> 126976 00010000:00010000:3.0:1789762828.412053:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.412062:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.412069:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.412074:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762828.412078:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.412087:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.412120:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.412128:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b599fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762828.412191:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515840:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6579us (199463us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789762828.412199:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:3.0:1789762828.412204:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130842721577 time 130842833038 state 0x2 ref 0 00000100:00100000:2.0:1789762828.414258:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762828.414307:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246515968 00000100:00100000:0.0:1789762828.414318:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246515968 00000100:00100000:0.0:1789762828.414362:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 130842721577 time 130842833038 state 0x0 ref 1 00000100:00100000:0.0:1789762828.414371:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131042833038 time 130842833038 state 0x1 ref 1 00000100:00100000:3.0:1789762828.605712:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131042833038 time 131042950182 state 0x0 ref 1 00000100:00100000:3.0:1789762828.605741:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515968:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762828.605843:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 65011712, mtime: 0x6aad9d0c, atime: 0x6aad9d00, ctime: 0x6aad9d0c, blocks: 0x1f000 00010000:00010000:3.0:1789762828.605853:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.605870:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=131s v=(0 0) 00010000:00010000:3.0:1789762828.605875:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762828.605881:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.605897:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762828.610981:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967376 is committed 00002000:00010000:3.0:1789762828.611066:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:3.0:1789762828.611073:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 126976 -> 129024 00010000:00010000:3.0:1789762828.611085:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.611099:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.611109:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.611117:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762828.611122:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.611132:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.611152:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762828.611161:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762828.611231:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246515968:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5501us (196970us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789762828.611249:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:3.0:1789762828.611256:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131042833038 time 131042950182 state 0x2 ref 0 00000100:00100000:1.0:1789762828.613462:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762828.613507:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516096 00000100:00100000:3.0:1789762828.613515:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516096 00000100:00100000:3.0:1789762828.613550:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131042833038 time 131042950182 state 0x0 ref 1 00000100:00100000:3.0:1789762828.613562:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131242950182 time 131042950182 state 0x1 ref 1 00000100:00100000:0.0:1789762828.675839:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762828.675872:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762828.675890:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762828.675916:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516352 00000100:00100000:0.0:1789762828.675923:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762828.675926:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516224 00000100:00100000:3.0:1789762828.675927:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516352 00000100:00100000:2.0:1789762828.675935:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516224 00000100:00100000:1.0:1789762828.675951:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516480 00000100:00100000:1.0:1789762828.675957:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516480 00000100:00100000:0.0:1789762828.675967:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516608 00000100:00100000:0.0:1789762828.675973:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516608 00000100:00100000:2.0:1789762828.675989:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:2.0:1789762828.676001:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246516224:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762828.676011:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1789762828.676019:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:1.0:1789762828.676024:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246516480:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762828.676029:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:3.0:1789762828.676039:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246516352:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762828.676046:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246516608:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762828.676066:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246516224:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 67us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762828.676072:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:1.0:1789762828.676078:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246516480:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 56us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762828.676086:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:0.0:1789762828.676094:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246516608:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762828.676102:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246516352:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762828.676104:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:3.0:1789762828.676116:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00080000:1.0:1789762828.676117:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762828.676122:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762828.805841:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131242950182 time 131243078510 state 0x0 ref 1 00000100:00100000:1.0:1789762828.805869:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246516096:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762828.805917:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 66060288, mtime: 0x6aad9d0c, atime: 0x6aad9d00, ctime: 0x6aad9d0c, blocks: 0x1f800 00010000:00010000:1.0:1789762828.805925:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.805938:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=131s v=(0 0) 00010000:00010000:1.0:1789762828.805942:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762828.805946:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.805957:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762828.811348:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967377 is committed 00002000:00010000:1.0:1789762828.811404:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:1.0:1789762828.811409:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 129024 -> 131072 00010000:00010000:1.0:1789762828.811420:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.811444:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.811455:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.811464:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762828.811469:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.811480:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.811499:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762828.811507:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59a0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762828.811573:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246516096:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5715us (198109us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789762828.811587:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:1.0:1789762828.811593:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131242950182 time 131243078510 state 0x2 ref 0 00000100:00100000:2.0:1789762828.813895:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762828.813939:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516736 00000100:00100000:3.0:1789762828.813948:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516736 00000100:00100000:3.0:1789762828.813980:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131242950182 time 131243078510 state 0x0 ref 1 00000100:00100000:3.0:1789762828.813990:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131443078510 time 131243078510 state 0x1 ref 1 00000100:00100000:2.0:1789762829.005927:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131443078510 time 131443164182 state 0x0 ref 1 00000100:00100000:2.0:1789762829.005962:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246516736:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762829.006014:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 67108864, mtime: 0x6aad9d0c, atime: 0x6aad9d00, ctime: 0x6aad9d0c, blocks: 0x20000 00010000:00010000:2.0:1789762829.006022:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762829.006036:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=131s v=(0 0) 00010000:00010000:2.0:1789762829.006051:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762829.006056:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762829.006070:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762829.010789:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967378 is committed 00002000:00010000:1.0:1789762829.010852:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:1.0:1789762829.010857:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762828 -> 1789762829 00002000:00010000:1.0:1789762829.010859:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762828 -> 1789762829 00002000:00010000:1.0:1789762829.010861:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 131072 -> 133120 00010000:00010000:1.0:1789762829.010871:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762829.010881:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762829.010887:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762829.010892:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762829.010896:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762829.010902:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762829.010917:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762829.010932:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b59a13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762829.010996:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246516736:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5049us (197101us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789762829.011004:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:1.0:1789762829.011011:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131443078510 time 131443164182 state 0x2 ref 0 00000100:00100000:2.0:1789762829.013198:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762829.013263:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516864 00000100:00100000:3.0:1789762829.013278:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516864 00000100:00100000:3.0:1789762829.013331:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131443078510 time 131443164182 state 0x0 ref 1 00000100:00100000:3.0:1789762829.013343:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131643164182 time 131443164182 state 0x1 ref 1 00010000:00010000:2.0:1789762829.178907:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762829.206062:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131643164182 time 131643300772 state 0x0 ref 1 00000100:00100000:0.0:1789762829.206104:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246516864:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762829.206155:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 68157440, mtime: 0x6aad9d0d, atime: 0x6aad9d00, ctime: 0x6aad9d0d, blocks: 0x20800 00010000:00010000:0.0:1789762829.206162:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.206176:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=131s v=(0 0) 00010000:00010000:0.0:1789762829.206179:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762829.206184:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.206195:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762829.211212:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967379 is committed 00002000:00010000:3.0:1789762829.211321:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:3.0:1789762829.211336:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 133120 -> 135168 00010000:00010000:3.0:1789762829.211350:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.211360:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.211368:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.211373:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762829.211377:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.211386:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.211404:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.211409:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59a1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762829.211523:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246516864:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5426us (198323us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789762829.211534:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:3.0:1789762829.211542:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131643164182 time 131643300772 state 0x2 ref 0 00000100:00100000:2.0:1789762829.213748:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762829.213831:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246516992 00000100:00100000:1.0:1789762829.213843:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246516992 00000100:00100000:1.0:1789762829.213893:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131643164182 time 131643300772 state 0x0 ref 1 00000100:00100000:1.0:1789762829.213906:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131843300772 time 131643300772 state 0x1 ref 1 00000100:00100000:0.0:1789762829.406230:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131843300772 time 131843462463 state 0x0 ref 1 00000100:00100000:0.0:1789762829.406272:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246516992:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762829.406342:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 69206016, mtime: 0x6aad9d0d, atime: 0x6aad9d00, ctime: 0x6aad9d0d, blocks: 0x21000 00010000:00010000:0.0:1789762829.406351:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.406369:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=131s v=(0 0) 00010000:00010000:0.0:1789762829.406374:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762829.406380:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.406431:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762829.411325:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967380 is committed 00002000:00010000:0.0:1789762829.411395:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:0.0:1789762829.411400:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 135168 -> 137216 00010000:00010000:0.0:1789762829.411412:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.411434:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.411445:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.411455:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762829.411461:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.411473:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.411492:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.411498:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762829.411580:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246516992:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5330us (197833us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789762829.411591:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:0.0:1789762829.411597:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131843300772 time 131843462463 state 0x2 ref 0 00000100:00100000:2.0:1789762829.414050:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762829.414096:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246517120 00000100:00100000:1.0:1789762829.414106:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246517120 00000100:00100000:1.0:1789762829.414149:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 131843300772 time 131843462463 state 0x0 ref 1 00000100:00100000:1.0:1789762829.414160:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132043462463 time 131843462463 state 0x1 ref 1 00000100:00100000:0.0:1789762829.606390:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132043462463 time 132043621217 state 0x0 ref 1 00000100:00100000:0.0:1789762829.606453:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517120:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762829.606535:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 70254592, mtime: 0x6aad9d0d, atime: 0x6aad9d00, ctime: 0x6aad9d0d, blocks: 0x21800 00010000:00010000:0.0:1789762829.606548:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.606570:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=132s v=(0 0) 00010000:00010000:0.0:1789762829.606577:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762829.606585:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762829.606608:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762829.611715:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967381 is committed 00002000:00010000:3.0:1789762829.611819:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:3.0:1789762829.611828:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 137216 -> 139264 00010000:00010000:3.0:1789762829.611840:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.611851:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.611858:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.611862:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762829.611866:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.611873:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.611888:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.611893:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eba71e2/0x5915dfb1c1b59a28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762829.611972:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517120:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5556us (197920us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789762829.611997:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:3.0:1789762829.612005:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132043462463 time 132043621217 state 0x2 ref 0 00000100:00100000:2.0:1789762829.614502:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762829.614542:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246517248 00000100:00100000:3.0:1789762829.614552:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246517248 00000100:00100000:3.0:1789762829.614595:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132043462463 time 132043621217 state 0x0 ref 1 00000100:00100000:3.0:1789762829.614606:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132243621217 time 132043621217 state 0x1 ref 1 00000100:00100000:3.0:1789762829.806487:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132243621217 time 132243725538 state 0x0 ref 1 00000100:00100000:3.0:1789762829.806517:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246517248:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762829.806566:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 71303168, mtime: 0x6aad9d0d, atime: 0x6aad9d00, ctime: 0x6aad9d0d, blocks: 0x22000 00010000:00010000:3.0:1789762829.806573:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.806588:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=132s v=(0 0) 00010000:00010000:3.0:1789762829.806592:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762829.806596:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.806607:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762829.812031:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967382 is committed 00002000:00010000:3.0:1789762829.812124:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:3.0:1789762829.812132:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 139264 -> 141312 00010000:00010000:3.0:1789762829.812145:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.812167:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.812178:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.812186:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762829.812192:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.812202:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.812221:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762829.812230:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762829.812308:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246517248:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5802us (197806us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1789762829.812321:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:3.0:1789762829.812329:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132243621217 time 132243725538 state 0x2 ref 0 00000100:00100000:0.0:1789762829.814945:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762829.814989:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246517376 00000100:00100000:3.0:1789762829.815003:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246517376 00000100:00100000:3.0:1789762829.815037:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132243621217 time 132243725538 state 0x0 ref 1 00000100:00100000:3.0:1789762829.815046:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132443725538 time 132243725538 state 0x1 ref 1 00000100:00100000:3.0:1789762830.006592:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132443725538 time 132443829285 state 0x0 ref 1 00000100:00100000:3.0:1789762830.006641:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517376:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:1.0:1789762830.006676:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762830.006697:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 72351744, mtime: 0x6aad9d0d, atime: 0x6aad9d00, ctime: 0x6aad9d0d, blocks: 0x22800 00010000:00010000:3.0:1789762830.006705:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.006719:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=132s v=(0 0) 00010000:00010000:3.0:1789762830.006723:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762830.006727:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.006738:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762830.011581:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967383 is committed 00002000:00010000:3.0:1789762830.011697:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:3.0:1789762830.011703:0:12138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762829 -> 1789762830 00002000:00010000:3.0:1789762830.011705:0:12138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762829 -> 1789762830 00002000:00010000:3.0:1789762830.011707:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 141312 -> 143360 00010000:00010000:3.0:1789762830.011721:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.011743:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.011788:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.011797:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762830.011803:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.011812:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.011831:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762830.011836:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762830.011924:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517376:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5312us (196975us total) trans 4294967383 rc 0/0 00000100:00100000:3.0:1789762830.011934:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:3.0:1789762830.011943:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132443725538 time 132443829285 state 0x2 ref 0 00000100:00100000:1.0:1789762830.014544:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762830.014591:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246517504 00000100:00100000:3.0:1789762830.014601:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246517504 00000100:00100000:3.0:1789762830.014646:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132443725538 time 132443829285 state 0x0 ref 1 00000100:00100000:3.0:1789762830.014657:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132643829285 time 132443829285 state 0x1 ref 1 00000100:00100000:0.0:1789762830.138932:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254901760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762830.139018:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762830.139077:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254901760 00000100:00100000:3.0:1789762830.139091:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254901760 00000100:00080000:1.0:1789762830.139146:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762830.139188:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789762830.139205:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254901760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762830.139234:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3858657280 avail 3618549760 00000100:00100000:3.0:1789762830.139287:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254901760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762830.139294:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789762830.139338:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254901760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762830.202907:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762830.206669:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132643829285 time 132643910922 state 0x0 ref 1 00000100:00100000:1.0:1789762830.206697:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246517504:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762830.206743:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 73400320, mtime: 0x6aad9d0e, atime: 0x6aad9d00, ctime: 0x6aad9d0e, blocks: 0x23000 00010000:00010000:1.0:1789762830.206780:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.206793:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=132s v=(0 0) 00010000:00010000:1.0:1789762830.206797:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762830.206801:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.206811:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762830.211795:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967384 is committed 00002000:00010000:1.0:1789762830.211874:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:1.0:1789762830.211881:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 143360 -> 145408 00010000:00010000:1.0:1789762830.211894:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.211908:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.211919:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.211927:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762830.211930:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.211938:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.211965:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.211974:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762830.212055:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246517504:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5369us (197516us total) trans 4294967384 rc 0/0 00000100:00100000:1.0:1789762830.212066:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:1.0:1789762830.212076:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132643829285 time 132643910922 state 0x2 ref 0 00000100:00100000:2.0:1789762830.214721:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762830.214806:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246517632 00000100:00100000:3.0:1789762830.214819:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246517632 00000100:00100000:3.0:1789762830.214879:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132643829285 time 132643910922 state 0x0 ref 1 00000100:00100000:3.0:1789762830.214895:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132843910922 time 132643910922 state 0x1 ref 1 00000100:00100000:1.0:1789762830.406807:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132843910922 time 132844045422 state 0x0 ref 1 00000100:00100000:1.0:1789762830.406836:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517632:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762830.406893:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 74448896, mtime: 0x6aad9d0e, atime: 0x6aad9d00, ctime: 0x6aad9d0e, blocks: 0x23800 00010000:00010000:1.0:1789762830.406901:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.406914:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=132s v=(0 0) 00010000:00010000:1.0:1789762830.406917:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762830.406922:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.406933:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762830.412349:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967385 is committed 00002000:00010000:1.0:1789762830.412426:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:1.0:1789762830.412434:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 145408 -> 147456 00010000:00010000:1.0:1789762830.412443:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.412451:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.412458:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.412463:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762830.412467:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.412477:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.412494:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762830.412503:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59a44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762830.412571:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517632:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5747us (197854us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1789762830.412590:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:1.0:1789762830.412596:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132843910922 time 132844045422 state 0x2 ref 0 00000100:00100000:3.0:1789762830.415037:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762830.415087:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246517760 00000100:00100000:2.0:1789762830.415098:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246517760 00000100:00100000:2.0:1789762830.415157:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 132843910922 time 132844045422 state 0x0 ref 1 00000100:00100000:2.0:1789762830.415168:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133044045422 time 132844045422 state 0x1 ref 1 00000100:00100000:0.0:1789762830.606950:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133044045422 time 133044187738 state 0x0 ref 1 00000100:00100000:0.0:1789762830.606979:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246517760:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762830.607030:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 75497472, mtime: 0x6aad9d0e, atime: 0x6aad9d00, ctime: 0x6aad9d0e, blocks: 0x24000 00010000:00010000:0.0:1789762830.607037:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.607051:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=133s v=(0 0) 00010000:00010000:0.0:1789762830.607055:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762830.607060:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.607073:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762830.612102:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967386 is committed 00002000:00010000:0.0:1789762830.612173:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:0.0:1789762830.612177:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 147456 -> 149504 00010000:00010000:0.0:1789762830.612185:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.612193:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.612199:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.612213:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762830.612216:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.612223:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.612236:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.612241:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762830.612296:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246517760:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5330us (197262us total) trans 4294967386 rc 0/0 00000100:00100000:0.0:1789762830.612303:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:0.0:1789762830.612308:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133044045422 time 133044187738 state 0x2 ref 0 00000100:00100000:2.0:1789762830.614606:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762830.614657:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246517888 00000100:00100000:1.0:1789762830.614666:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246517888 00000100:00100000:1.0:1789762830.614705:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133044045422 time 133044187738 state 0x0 ref 1 00000100:00100000:1.0:1789762830.614716:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133244187738 time 133044187738 state 0x1 ref 1 00000100:00100000:0.0:1789762830.807071:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133244187738 time 133244298803 state 0x0 ref 1 00000100:00100000:0.0:1789762830.807106:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517888:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762830.807157:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 76546048, mtime: 0x6aad9d0e, atime: 0x6aad9d00, ctime: 0x6aad9d0e, blocks: 0x24800 00010000:00010000:0.0:1789762830.807164:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.807195:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=133s v=(0 0) 00010000:00010000:0.0:1789762830.807199:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762830.807203:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.807214:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762830.811720:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967387 is committed 00002000:00010000:0.0:1789762830.811813:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:0.0:1789762830.811820:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 149504 -> 151552 00010000:00010000:0.0:1789762830.811833:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.811845:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.811855:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.811864:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762830.811869:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.811880:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.811914:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762830.811925:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e65c7f/0x5915dfb1c1b59a52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762830.811996:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246517888:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4903us (197388us total) trans 4294967387 rc 0/0 00000100:00100000:0.0:1789762830.812007:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:0.0:1789762830.812014:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133244187738 time 133244298803 state 0x2 ref 0 00000100:00100000:3.0:1789762830.814201:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762830.814254:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518016 00000100:00100000:1.0:1789762830.814262:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518016 00000100:00100000:1.0:1789762830.814294:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133244187738 time 133244298803 state 0x0 ref 1 00000100:00100000:1.0:1789762830.814303:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133444298803 time 133244298803 state 0x1 ref 1 00000100:00100000:3.0:1789762831.007192:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133444298803 time 133444431342 state 0x0 ref 1 00000100:00100000:3.0:1789762831.007222:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518016:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762831.007271:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 77594624, mtime: 0x6aad9d0e, atime: 0x6aad9d00, ctime: 0x6aad9d0e, blocks: 0x25000 00010000:00010000:3.0:1789762831.007279:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762831.007292:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=133s v=(0 0) 00010000:00010000:3.0:1789762831.007296:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762831.007300:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762831.007330:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762831.012127:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967388 is committed 00002000:00010000:0.0:1789762831.012207:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:0.0:1789762831.012213:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762830 -> 1789762831 00002000:00010000:0.0:1789762831.012217:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762830 -> 1789762831 00002000:00010000:0.0:1789762831.012220:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 151552 -> 153600 00010000:00010000:0.0:1789762831.012231:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.012240:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.012247:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.012252:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762831.012262:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.012270:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.012283:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.012289:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b5e9db/0x5915dfb1c1b59a59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762831.012342:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518016:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5134us (198142us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789762831.012350:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:0.0:1789762831.012355:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133444298803 time 133444431342 state 0x2 ref 0 00000100:00100000:3.0:1789762831.014891:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762831.014935:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518144 00000100:00100000:0.0:1789762831.014945:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518144 00000100:00100000:0.0:1789762831.015003:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133444298803 time 133444431342 state 0x0 ref 1 00000100:00100000:0.0:1789762831.015016:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133644431342 time 133444431342 state 0x1 ref 1 00000100:00100000:3.0:1789762831.207360:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133644431342 time 133644598915 state 0x0 ref 1 00000100:00100000:3.0:1789762831.207388:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518144:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762831.207451:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 78643200, mtime: 0x6aad9d0f, atime: 0x6aad9d00, ctime: 0x6aad9d0f, blocks: 0x25800 00010000:00010000:3.0:1789762831.207459:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762831.207473:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=133s v=(0 0) 00010000:00010000:3.0:1789762831.207477:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762831.207482:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762831.207493:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762831.212505:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967389 is committed 00002000:00010000:0.0:1789762831.212571:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:0.0:1789762831.212576:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 153600 -> 155648 00010000:00010000:0.0:1789762831.212585:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.212593:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.212610:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.212616:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762831.212619:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.212626:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.212640:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.212645:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59a60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762831.212697:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518144:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5322us (197808us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789762831.212705:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:0.0:1789762831.212716:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133644431342 time 133644598915 state 0x2 ref 0 00000100:00100000:3.0:1789762831.215401:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762831.215454:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518272 00000100:00100000:0.0:1789762831.215461:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518272 00000100:00100000:0.0:1789762831.215499:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133644431342 time 133644598915 state 0x0 ref 1 00000100:00100000:0.0:1789762831.215513:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133844598915 time 133644598915 state 0x1 ref 1 00010000:00010000:0.0:1789762831.226878:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762831.407496:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133844598915 time 133844734590 state 0x0 ref 1 00000100:00100000:2.0:1789762831.407526:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518272:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762831.407576:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 79691776, mtime: 0x6aad9d0f, atime: 0x6aad9d00, ctime: 0x6aad9d0f, blocks: 0x26000 00010000:00010000:2.0:1789762831.407583:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.407596:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=133s v=(0 0) 00010000:00010000:2.0:1789762831.407599:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762831.407604:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.407615:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762831.413329:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967390 is committed 00002000:00010000:2.0:1789762831.413445:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:2.0:1789762831.413451:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 155648 -> 157696 00010000:00010000:2.0:1789762831.413459:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.413467:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.413474:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.413490:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762831.413494:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.413501:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.413513:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762831.413518:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59a67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762831.413575:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518272:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6063us (198176us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789762831.413582:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:2.0:1789762831.413587:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133844598915 time 133844734590 state 0x2 ref 0 00000100:00100000:3.0:1789762831.416160:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762831.416213:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518400 00000100:00100000:0.0:1789762831.416222:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518400 00000100:00100000:0.0:1789762831.416255:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 133844598915 time 133844734590 state 0x0 ref 1 00000100:00100000:0.0:1789762831.416264:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134044734590 time 133844734590 state 0x1 ref 1 00000100:00100000:1.0:1789762831.607622:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134044734590 time 134044859269 state 0x0 ref 1 00000100:00100000:1.0:1789762831.607655:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518400:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762831.607712:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 80740352, mtime: 0x6aad9d0f, atime: 0x6aad9d00, ctime: 0x6aad9d0f, blocks: 0x26800 00010000:00010000:1.0:1789762831.607722:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.607738:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=134s v=(0 0) 00010000:00010000:1.0:1789762831.607743:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762831.607793:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.607812:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762831.612916:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967391 is committed 00002000:00010000:0.0:1789762831.612984:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:0.0:1789762831.612989:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 157696 -> 159744 00010000:00010000:0.0:1789762831.612997:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.613006:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.613012:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.613017:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762831.613021:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.613028:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.613041:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762831.613059:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59a6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762831.613130:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518400:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5490us (196974us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789762831.613142:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:0.0:1789762831.613147:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134044734590 time 134044859269 state 0x2 ref 0 00000100:00100000:0.0:1789762831.615383:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762831.615447:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518528 00000100:00100000:3.0:1789762831.615459:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518528 00000100:00100000:3.0:1789762831.615512:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134044734590 time 134044859269 state 0x0 ref 1 00000100:00100000:3.0:1789762831.615524:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134244859269 time 134044859269 state 0x1 ref 1 00000100:00100000:1.0:1789762831.807825:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134244859269 time 134245062922 state 0x0 ref 1 00000100:00100000:1.0:1789762831.807854:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518528:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762831.807904:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 81788928, mtime: 0x6aad9d0f, atime: 0x6aad9d00, ctime: 0x6aad9d0f, blocks: 0x27000 00010000:00010000:1.0:1789762831.807911:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.807924:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=134s v=(0 0) 00010000:00010000:1.0:1789762831.807927:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762831.807931:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.807943:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762831.812797:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967392 is committed 00002000:00010000:1.0:1789762831.812905:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:1.0:1789762831.812911:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 159744 -> 161792 00010000:00010000:1.0:1789762831.812919:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.812927:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.812934:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.812953:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762831.812956:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.812962:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.812975:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762831.812980:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59a75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762831.813040:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518528:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5199us (197656us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789762831.813047:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:1.0:1789762831.813053:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134244859269 time 134245062922 state 0x2 ref 0 00000100:00100000:0.0:1789762831.815656:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762831.815712:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518656 00000100:00100000:2.0:1789762831.815721:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518656 00000100:00100000:2.0:1789762831.815778:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134244859269 time 134245062922 state 0x0 ref 1 00000100:00100000:2.0:1789762831.815790:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134445062922 time 134245062922 state 0x1 ref 1 00000100:00100000:3.0:1789762832.007985:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134445062922 time 134445212600 state 0x0 ref 1 00000100:00100000:3.0:1789762832.008037:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518656:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:1.0:1789762832.008083:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762832.008107:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 82837504, mtime: 0x6aad9d0f, atime: 0x6aad9d00, ctime: 0x6aad9d0f, blocks: 0x27800 00010000:00010000:3.0:1789762832.008117:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.008142:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=134s v=(0 0) 00010000:00010000:3.0:1789762832.008147:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762832.008155:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.008174:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762832.013188:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967393 is committed 00002000:00010000:3.0:1789762832.013260:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789762832.013267:0:6916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762831 -> 1789762832 00002000:00010000:3.0:1789762832.013270:0:6916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762831 -> 1789762832 00002000:00010000:3.0:1789762832.013274:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 161792 -> 163840 00010000:00010000:3.0:1789762832.013286:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.013299:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.013318:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.013327:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762832.013333:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.013344:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.013366:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.013376:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762832.013465:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518656:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5459us (197811us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789762832.013476:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:3.0:1789762832.013482:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134445062922 time 134445212600 state 0x2 ref 0 00000100:00100000:1.0:1789762832.015639:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762832.015698:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518784 00000100:00100000:0.0:1789762832.015710:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518784 00000100:00100000:0.0:1789762832.015800:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134445062922 time 134445212600 state 0x0 ref 1 00000100:00100000:0.0:1789762832.015817:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134645212600 time 134445212600 state 0x1 ref 1 00000100:00100000:0.0:1789762832.208080:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134645212600 time 134645310704 state 0x0 ref 1 00000100:00100000:0.0:1789762832.208130:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518784:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762832.208209:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 83886080, mtime: 0x6aad9d10, atime: 0x6aad9d00, ctime: 0x6aad9d10, blocks: 0x28000 00010000:00010000:0.0:1789762832.208221:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762832.208244:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=134s v=(0 0) 00010000:00010000:0.0:1789762832.208249:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762832.208258:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762832.208294:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762832.212991:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967394 is committed 00002000:00010000:3.0:1789762832.213071:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:3.0:1789762832.213078:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 163840 -> 165888 00010000:00010000:3.0:1789762832.213090:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.213111:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.213119:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.213124:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762832.213127:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.213135:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.213149:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.213154:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30fd77c/0x5915dfb1c1b59a83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762832.213222:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246518784:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5116us (197583us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789762832.213230:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:3.0:1789762832.213236:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134645212600 time 134645310704 state 0x2 ref 0 00000100:00100000:1.0:1789762832.215497:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762832.215544:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246518912 00000100:00100000:2.0:1789762832.215553:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246518912 00000100:00100000:2.0:1789762832.215587:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134645212600 time 134645310704 state 0x0 ref 1 00000100:00100000:2.0:1789762832.215597:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134845310704 time 134645310704 state 0x1 ref 1 00010000:00010000:2.0:1789762832.250875:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762832.408192:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134845310704 time 134845422935 state 0x0 ref 1 00000100:00100000:0.0:1789762832.408240:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518912:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762832.408317:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 84934656, mtime: 0x6aad9d10, atime: 0x6aad9d00, ctime: 0x6aad9d10, blocks: 0x28800 00010000:00010000:0.0:1789762832.408330:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762832.408354:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=134s v=(0 0) 00010000:00010000:0.0:1789762832.408360:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762832.408368:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762832.408387:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762832.412862:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967395 is committed 00002000:00010000:3.0:1789762832.412931:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789762832.412942:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 165888 -> 167936 00010000:00010000:3.0:1789762832.412954:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.412963:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.412970:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.412975:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762832.412979:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.412986:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.413001:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.413007:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59a8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762832.413077:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246518912:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4858us (197576us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789762832.413089:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:3.0:1789762832.413097:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134845310704 time 134845422935 state 0x2 ref 0 00000100:00100000:0.0:1789762832.415192:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762832.415243:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519040 00000100:00100000:3.0:1789762832.415253:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519040 00000100:00100000:3.0:1789762832.415296:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 134845310704 time 134845422935 state 0x0 ref 1 00000100:00100000:3.0:1789762832.415308:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135045422935 time 134845422935 state 0x1 ref 1 00000100:00100000:3.0:1789762832.608268:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135045422935 time 135045505990 state 0x0 ref 1 00000100:00100000:3.0:1789762832.608296:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519040:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762832.608348:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 85983232, mtime: 0x6aad9d10, atime: 0x6aad9d00, ctime: 0x6aad9d10, blocks: 0x29000 00010000:00010000:3.0:1789762832.608357:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.608374:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=135s v=(0 0) 00010000:00010000:3.0:1789762832.608379:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762832.608386:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.608415:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762832.613284:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967396 is committed 00002000:00010000:3.0:1789762832.613340:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789762832.613346:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 167936 -> 169984 00010000:00010000:3.0:1789762832.613355:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.613367:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.613384:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.613390:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762832.613393:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.613412:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.613424:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.613430:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762832.613482:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519040:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5199us (198292us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789762832.613488:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:3.0:1789762832.613493:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135045422935 time 135045505990 state 0x2 ref 0 00000100:00100000:0.0:1789762832.615680:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762832.615721:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519168 00000100:00100000:3.0:1789762832.615728:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519168 00000100:00100000:3.0:1789762832.615771:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135045422935 time 135045505990 state 0x0 ref 1 00000100:00100000:3.0:1789762832.615780:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135245505990 time 135045505990 state 0x1 ref 1 00000100:00100000:3.0:1789762832.808352:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135245505990 time 135245589755 state 0x0 ref 1 00000100:00100000:3.0:1789762832.808379:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246519168:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762832.808442:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 87031808, mtime: 0x6aad9d10, atime: 0x6aad9d00, ctime: 0x6aad9d10, blocks: 0x29800 00010000:00010000:3.0:1789762832.808450:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.808464:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=135s v=(0 0) 00010000:00010000:3.0:1789762832.808468:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762832.808472:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.808484:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762832.813280:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967397 is committed 00002000:00010000:3.0:1789762832.813344:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:3.0:1789762832.813350:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 169984 -> 172032 00010000:00010000:3.0:1789762832.813359:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.813368:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.813375:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.813389:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762832.813393:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.813418:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.813431:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762832.813436:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59a98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762832.813490:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246519168:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5123us (197816us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789762832.813496:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:3.0:1789762832.813501:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135245505990 time 135245589755 state 0x2 ref 0 00000100:00100000:0.0:1789762832.815654:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762832.815694:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519296 00000100:00100000:3.0:1789762832.815702:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519296 00000100:00100000:3.0:1789762832.815731:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135245505990 time 135245589755 state 0x0 ref 1 00000100:00100000:3.0:1789762832.815740:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135445589755 time 135245589755 state 0x1 ref 1 00000100:00100000:0.0:1789762833.008451:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135445589755 time 135445690269 state 0x0 ref 1 00000100:00100000:0.0:1789762833.008480:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519296:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762833.008546:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 88080384, mtime: 0x6aad9d10, atime: 0x6aad9d00, ctime: 0x6aad9d10, blocks: 0x2a000 00010000:00010000:0.0:1789762833.008554:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.008567:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=135s v=(0 0) 00010000:00010000:0.0:1789762833.008571:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762833.008575:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.008587:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762833.013166:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967398 is committed 00002000:00010000:0.0:1789762833.013224:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:0.0:1789762833.013229:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762832 -> 1789762833 00002000:00010000:0.0:1789762833.013231:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762832 -> 1789762833 00002000:00010000:0.0:1789762833.013232:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 172032 -> 174080 00010000:00010000:0.0:1789762833.013240:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.013248:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.013254:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.013259:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762833.013269:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.013276:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.013289:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.013295:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59a9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762833.013354:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519296:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4886us (197705us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789762833.013364:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:0.0:1789762833.013371:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135445589755 time 135445690269 state 0x2 ref 0 00000100:00100000:3.0:1789762833.015503:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762833.015541:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519424 00000100:00100000:0.0:1789762833.015548:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519424 00000100:00100000:0.0:1789762833.015576:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135445589755 time 135445690269 state 0x0 ref 1 00000100:00100000:0.0:1789762833.015584:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135645690269 time 135445690269 state 0x1 ref 1 00000100:00100000:2.0:1789762833.208533:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135645690269 time 135645772234 state 0x0 ref 1 00000100:00100000:2.0:1789762833.208561:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519424:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762833.208610:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 89128960, mtime: 0x6aad9d11, atime: 0x6aad9d00, ctime: 0x6aad9d11, blocks: 0x2a800 00010000:00010000:2.0:1789762833.208617:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.208631:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=135s v=(0 0) 00010000:00010000:2.0:1789762833.208634:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762833.208639:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.208650:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762833.210860:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254901888:0@lo:400:kworker.0 00000100:00100000:1.0:1789762833.210873:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254902016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762833.210931:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762833.210939:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762833.210950:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254902272:0@lo:400:kworker.0 00000100:00100000:0.0:1789762833.210998:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762833.211009:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254902528:0@lo:400:kworker.0 00000100:00100000:3.0:1789762833.211012:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254902400:0@lo:400:kworker.0 00000100:00100000:0.0:1789762833.211057:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254902144:0@lo:400:kworker.0 00000100:00100000:1.0:1789762833.211058:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762833.211093:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762833.211108:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762833.211112:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902016 00000100:00100000:1.0:1789762833.211119:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902016 00000100:00100000:3.0:1789762833.211139:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254901888 00000100:00100000:3.0:1789762833.211144:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254901888 00000100:00100000:0.0:1789762833.211147:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254902656:0@lo:400:kworker.0 00000100:00100000:1.0:1789762833.211183:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789762833.211191:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789762833.211196:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762833.211197:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254902016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762833.211206:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254901888:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789762833.211220:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42320448 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762833.211240:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902272 00000100:00100000:0.0:1789762833.211247:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902272 00000100:00100000:3.0:1789762833.211261:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254901888:12345-0@lo:400:kworker.0 Request processed in 58us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762833.211270:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254902016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762833.211276:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789762833.211289:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902528 00000100:00100000:0.0:1789762833.211294:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902528 00000100:00080000:1.0:1789762833.211299:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762833.211303:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762833.211321:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789762833.211328:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902144 00000100:00100000:0.0:1789762833.211335:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902144 00000100:00100000:1.0:1789762833.211338:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254902016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762833.211369:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254901888:0@lo:400:kworker.0 00000100:00100000:0.0:1789762833.211376:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789762833.211389:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254902272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762833.211412:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902400 00000100:00100000:1.0:1789762833.211417:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902400 00000100:00100000:1.0:1789762833.211462:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902656 00000100:00100000:0.0:1789762833.211464:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254902272:12345-0@lo:400:kworker.0 Request processed in 77us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762833.211466:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902656 00000100:00100000:3.0:1789762833.211475:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789762833.211480:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789762833.211494:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789762833.211504:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254902656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762833.211511:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789762833.211524:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254902528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762833.211532:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254902400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762833.211547:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254902656:12345-0@lo:400:kworker.0 Request processed in 46us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762833.211554:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789762833.211578:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762833.211594:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254902528:12345-0@lo:400:kworker.0 Request processed in 72us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762833.211596:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254902400:12345-0@lo:400:kworker.0 Request processed in 113us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762833.211607:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254902528:0@lo:400:kworker.0 00000100:00100000:0.0:1789762833.211609:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789762833.211611:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789762833.211640:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789762833.211650:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254902144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762833.211682:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254902272:0@lo:400:kworker.0 00000100:00100000:0.0:1789762833.211689:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254902144:12345-0@lo:400:kworker.0 Request processed in 41us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762833.211689:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254902400:0@lo:400:kworker.0 00000100:00100000:0.0:1789762833.211705:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789762833.211729:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254902144:0@lo:400:kworker.0 00000100:00100000:1.0:1789762833.211742:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254902656:0@lo:400:kworker.0 00000001:00080000:3.0:1789762833.213174:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967399 is committed 00002000:00010000:2.0:1789762833.213263:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:2.0:1789762833.213269:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 174080 -> 176128 00010000:00010000:2.0:1789762833.213284:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.213293:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.213299:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.213304:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762833.213308:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.213315:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.213327:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762833.213333:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b59aa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762833.213380:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519424:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4832us (197877us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789762833.213387:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:2.0:1789762833.213404:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135645690269 time 135645772234 state 0x2 ref 0 00000100:00100000:1.0:1789762833.215776:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762833.215821:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519552 00000100:00100000:3.0:1789762833.215826:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519552 00000100:00100000:3.0:1789762833.215850:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135645690269 time 135645772234 state 0x0 ref 1 00000100:00100000:3.0:1789762833.215857:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135845772234 time 135645772234 state 0x1 ref 1 00010000:00010000:2.0:1789762833.274854:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762833.408604:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135845772234 time 135845842672 state 0x0 ref 1 00000100:00100000:0.0:1789762833.408632:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246519552:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762833.408681:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 90177536, mtime: 0x6aad9d11, atime: 0x6aad9d00, ctime: 0x6aad9d11, blocks: 0x2b000 00010000:00010000:0.0:1789762833.408702:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.408719:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=135s v=(0 0) 00010000:00010000:0.0:1789762833.408724:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762833.408731:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.408748:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762833.413191:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967400 is committed 00002000:00010000:1.0:1789762833.413246:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:1.0:1789762833.413251:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 176128 -> 178176 00010000:00010000:1.0:1789762833.413259:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.413267:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.413273:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.413278:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762833.413281:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.413288:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.413301:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.413309:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59aad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762833.413373:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246519552:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4752us (197602us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789762833.413383:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:1.0:1789762833.413411:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135845772234 time 135845842672 state 0x2 ref 0 00000100:00100000:3.0:1789762833.415663:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762833.415708:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519680 00000100:00100000:0.0:1789762833.415716:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519680 00000100:00100000:0.0:1789762833.415745:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 135845772234 time 135845842672 state 0x0 ref 1 00000100:00100000:0.0:1789762833.415770:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136045842672 time 135845842672 state 0x1 ref 1 00000100:00100000:3.0:1789762833.608692:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136045842672 time 136045929895 state 0x0 ref 1 00000100:00100000:3.0:1789762833.608716:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246519680:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762833.608781:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 91226112, mtime: 0x6aad9d11, atime: 0x6aad9d00, ctime: 0x6aad9d11, blocks: 0x2b800 00010000:00010000:3.0:1789762833.608789:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762833.608802:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=136s v=(0 0) 00010000:00010000:3.0:1789762833.608806:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762833.608811:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762833.608824:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762833.613152:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967401 is committed 00002000:00010000:1.0:1789762833.613236:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:1.0:1789762833.613241:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 178176 -> 180224 00010000:00010000:1.0:1789762833.613250:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.613258:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.613264:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.613269:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762833.613273:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.613280:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.613293:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.613298:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e174db0b/0x5915dfb1c1b59ab4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762833.613354:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246519680:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4646us (197691us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789762833.613376:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:1.0:1789762833.613383:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136045842672 time 136045929895 state 0x2 ref 0 00000100:00100000:3.0:1789762833.615525:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762833.615580:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519808 00000100:00100000:2.0:1789762833.615587:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519808 00000100:00100000:2.0:1789762833.615618:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136045842672 time 136045929895 state 0x0 ref 1 00000100:00100000:2.0:1789762833.615627:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136245929895 time 136045929895 state 0x1 ref 1 00000100:00100000:0.0:1789762833.795892:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762833.795924:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762833.795952:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246519936 00000100:00100000:1.0:1789762833.795969:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246519936 00000100:00100000:0.0:1789762833.795970:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762833.796015:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520064 00000100:00100000:3.0:1789762833.796023:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520064 00000100:00100000:0.0:1789762833.796024:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762833.796034:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:2.0:1789762833.796043:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520320 00000100:00100000:1.0:1789762833.796048:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246519936:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762833.796048:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520320 00000100:00100000:0.0:1789762833.796074:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520192 00000100:00100000:0.0:1789762833.796080:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520192 00000100:00100000:3.0:1789762833.796102:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:2.0:1789762833.796114:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:3.0:1789762833.796118:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246520064:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762833.796124:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:1.0:1789762833.796126:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246519936:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762833.796131:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246520320:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762833.796143:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246520192:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762833.796144:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:3.0:1789762833.796173:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246520064:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762833.796181:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246520320:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00080000:1.0:1789762833.796188:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762833.796191:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246520192:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762833.796191:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00080000:1.0:1789762833.796194:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762833.796203:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:0.0:1789762833.796207:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:0.0:1789762833.808796:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136245929895 time 136246038362 state 0x0 ref 1 00000100:00100000:0.0:1789762833.808810:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519808:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762833.808847:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 92274688, mtime: 0x6aad9d11, atime: 0x6aad9d00, ctime: 0x6aad9d11, blocks: 0x2c000 00010000:00010000:0.0:1789762833.808854:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.808874:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=136s v=(0 0) 00010000:00010000:0.0:1789762833.808878:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762833.808883:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762833.808894:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762833.813008:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967402 is committed 00002000:00010000:1.0:1789762833.813065:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:1.0:1789762833.813069:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 180224 -> 182272 00010000:00010000:1.0:1789762833.813078:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.813087:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.813093:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.813098:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762833.813102:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.813119:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.813132:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762833.813137:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b7b586d/0x5915dfb1c1b59abb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762833.813183:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246519808:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4375us (197659us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789762833.813190:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:1.0:1789762833.813194:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136245929895 time 136246038362 state 0x2 ref 0 00000100:00100000:3.0:1789762833.815308:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762833.815362:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520448 00000100:00100000:1.0:1789762833.815369:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520448 00000100:00100000:1.0:1789762833.815414:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136245929895 time 136246038362 state 0x0 ref 1 00000100:00100000:1.0:1789762833.815426:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136446038362 time 136246038362 state 0x1 ref 1 00000100:00100000:3.0:1789762834.008917:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136446038362 time 136446153505 state 0x0 ref 1 00000100:00100000:3.0:1789762834.008975:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246520448:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762834.009025:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 93323264, mtime: 0x6aad9d11, atime: 0x6aad9d00, ctime: 0x6aad9d11, blocks: 0x2c800 00000100:00080000:1.0:1789762834.009032:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762834.009032:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762834.009048:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=136s v=(0 0) 00010000:00010000:3.0:1789762834.009052:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762834.009058:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762834.009069:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762834.013550:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967403 is committed 00002000:00010000:1.0:1789762834.013605:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:1.0:1789762834.013609:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762833 -> 1789762834 00002000:00010000:1.0:1789762834.013611:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762833 -> 1789762834 00002000:00010000:1.0:1789762834.013613:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 182272 -> 184320 00010000:00010000:1.0:1789762834.013621:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762834.013637:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762834.013644:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762834.013648:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762834.013652:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762834.013658:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762834.013671:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762834.013676:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d23c61d/0x5915dfb1c1b59ac2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762834.013742:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246520448:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4785us (198428us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789762834.013782:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:1.0:1789762834.013788:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136446038362 time 136446153505 state 0x2 ref 0 00000100:00100000:3.0:1789762834.016141:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762834.016172:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520576 00000100:00100000:1.0:1789762834.016184:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520576 00000100:00100000:1.0:1789762834.016213:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136446038362 time 136446153505 state 0x0 ref 1 00000100:00100000:1.0:1789762834.016221:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136646153505 time 136446153505 state 0x1 ref 1 00000100:00100000:3.0:1789762834.209004:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136646153505 time 136646242160 state 0x0 ref 1 00000100:00100000:3.0:1789762834.209038:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246520576:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762834.209093:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 94371840, mtime: 0x6aad9d12, atime: 0x6aad9d00, ctime: 0x6aad9d12, blocks: 0x2d000 00010000:00010000:3.0:1789762834.209102:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762834.209116:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=136s v=(0 0) 00010000:00010000:3.0:1789762834.209119:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762834.209124:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762834.209156:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762834.213530:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967404 is committed 00002000:00010000:2.0:1789762834.213594:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:2.0:1789762834.213601:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 184320 -> 186368 00010000:00010000:2.0:1789762834.213612:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.213624:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.213635:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.213644:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762834.213648:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.213666:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.213679:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.213685:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59ac9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762834.213779:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246520576:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4729us (197610us total) trans 4294967404 rc 0/0 00000100:00100000:2.0:1789762834.213787:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:2.0:1789762834.213792:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136646153505 time 136646242160 state 0x2 ref 0 00000100:00100000:3.0:1789762834.216080:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762834.216158:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520704 00000100:00100000:1.0:1789762834.216167:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520704 00000100:00100000:1.0:1789762834.216197:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136646153505 time 136646242160 state 0x0 ref 1 00000100:00100000:1.0:1789762834.216206:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136846242160 time 136646242160 state 0x1 ref 1 00010000:00010000:1.0:1789762834.298870:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762834.409167:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136846242160 time 136846402805 state 0x0 ref 1 00000100:00100000:0.0:1789762834.409202:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246520704:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762834.409260:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 95420416, mtime: 0x6aad9d12, atime: 0x6aad9d00, ctime: 0x6aad9d12, blocks: 0x2d800 00010000:00010000:0.0:1789762834.409269:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.409286:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=136s v=(0 0) 00010000:00010000:0.0:1789762834.409289:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762834.409294:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.409323:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762834.415165:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967405 is committed 00002000:00010000:0.0:1789762834.415229:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:0.0:1789762834.415234:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 186368 -> 188416 00010000:00010000:0.0:1789762834.415242:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.415250:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.415257:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.415262:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762834.415265:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.415272:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.415285:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.415290:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1c3eba0/0x5915dfb1c1b59ad0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762834.415349:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246520704:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6163us (199269us total) trans 4294967405 rc 0/0 00000100:00100000:0.0:1789762834.415356:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:0.0:1789762834.415362:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136846242160 time 136846402805 state 0x2 ref 0 00000100:00100000:3.0:1789762834.417718:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762834.417783:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520832 00000100:00100000:1.0:1789762834.417792:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520832 00000100:00100000:1.0:1789762834.417835:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 136846242160 time 136846402805 state 0x0 ref 1 00000100:00100000:1.0:1789762834.417845:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137046402805 time 136846402805 state 0x1 ref 1 00000100:00100000:2.0:1789762834.609264:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137046402805 time 137046502277 state 0x0 ref 1 00000100:00100000:2.0:1789762834.609294:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246520832:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762834.609354:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 96468992, mtime: 0x6aad9d12, atime: 0x6aad9d00, ctime: 0x6aad9d12, blocks: 0x2e000 00010000:00010000:2.0:1789762834.609362:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.609376:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=137s v=(0 0) 00010000:00010000:2.0:1789762834.609395:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762834.609400:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.609428:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762834.613733:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967406 is committed 00002000:00010000:2.0:1789762834.613791:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:2.0:1789762834.613796:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 188416 -> 190464 00010000:00010000:2.0:1789762834.613804:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.613812:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.613818:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.613823:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762834.613827:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.613834:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.613846:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762834.613851:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b59ad7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762834.613908:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246520832:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4627us (196191us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789762834.613914:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:2.0:1789762834.613919:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137046402805 time 137046502277 state 0x2 ref 0 00000100:00100000:3.0:1789762834.615918:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762834.615955:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246520960 00000100:00100000:2.0:1789762834.615964:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246520960 00000100:00100000:2.0:1789762834.616001:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137046402805 time 137046502277 state 0x0 ref 1 00000100:00100000:2.0:1789762834.616010:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137246502277 time 137046502277 state 0x1 ref 1 00000100:00100000:0.0:1789762834.809392:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137246502277 time 137246619160 state 0x0 ref 1 00000100:00100000:0.0:1789762834.809422:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246520960:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762834.809469:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 97517568, mtime: 0x6aad9d12, atime: 0x6aad9d00, ctime: 0x6aad9d12, blocks: 0x2e800 00010000:00010000:0.0:1789762834.809476:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.809489:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=137s v=(0 0) 00010000:00010000:0.0:1789762834.809493:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762834.809497:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.809508:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762834.814099:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967407 is committed 00002000:00010000:0.0:1789762834.814160:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:0.0:1789762834.814164:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 190464 -> 192512 00010000:00010000:0.0:1789762834.814172:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.814190:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.814196:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.814200:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762834.814204:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.814211:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.814224:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762834.814229:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034baeef1/0x5915dfb1c1b59ade lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762834.814282:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246520960:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4872us (198363us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1789762834.814293:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:0.0:1789762834.814300:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137246502277 time 137246619160 state 0x2 ref 0 00000100:00100000:2.0:1789762834.816870:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762834.816908:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246521088 00000100:00100000:0.0:1789762834.816924:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246521088 00000100:00100000:0.0:1789762834.816963:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137246502277 time 137246619160 state 0x0 ref 1 00000100:00100000:0.0:1789762834.816972:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137446619160 time 137246619160 state 0x1 ref 1 00000100:00100000:3.0:1789762835.009495:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137446619160 time 137446734264 state 0x0 ref 1 00000100:00100000:3.0:1789762835.009523:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246521088:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762835.009569:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 98566144, mtime: 0x6aad9d12, atime: 0x6aad9d00, ctime: 0x6aad9d12, blocks: 0x2f000 00010000:00010000:3.0:1789762835.009577:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.009590:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=137s v=(0 0) 00010000:00010000:3.0:1789762835.009594:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762835.009599:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.009610:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762835.013885:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967408 is committed 00002000:00010000:3.0:1789762835.013932:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:3.0:1789762835.013941:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762834 -> 1789762835 00002000:00010000:3.0:1789762835.013943:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762834 -> 1789762835 00002000:00010000:3.0:1789762835.013945:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 192512 -> 194560 00010000:00010000:3.0:1789762835.013953:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.013961:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.013967:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.013972:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762835.013975:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.013981:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.014009:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762835.014015:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ca2986d/0x5915dfb1c1b59ae5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762835.014068:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246521088:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4556us (197196us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789762835.014088:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 109 00000100:00100000:3.0:1789762835.014095:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137446619160 time 137446734264 state 0x2 ref 0 00000100:00100000:2.0:1789762835.016469:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762835.016521:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246521216 00000100:00100000:0.0:1789762835.016529:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246521216 00000100:00100000:0.0:1789762835.016566:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137446619160 time 137446734264 state 0x0 ref 1 00000100:00100000:0.0:1789762835.016575:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137646734264 time 137446734264 state 0x1 ref 1 00000100:00100000:1.0:1789762835.209600:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137646734264 time 137646837434 state 0x0 ref 1 00000100:00100000:1.0:1789762835.209630:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246521216:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762835.209677:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 99614720, mtime: 0x6aad9d13, atime: 0x6aad9d00, ctime: 0x6aad9d13, blocks: 0x2f800 00010000:00010000:1.0:1789762835.209687:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.209704:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=137s v=(0 0) 00010000:00010000:1.0:1789762835.209709:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762835.209716:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.209777:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762835.213992:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967409 is committed 00002000:00010000:2.0:1789762835.214043:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:2.0:1789762835.214048:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 194560 -> 196608 00010000:00010000:2.0:1789762835.214056:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.214064:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.214071:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.214076:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762835.214080:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.214093:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.214106:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.214111:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f59308/0x5915dfb1c1b59aec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762835.214162:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246521216:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4546us (197694us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789762835.214169:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:2.0:1789762835.214174:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137646734264 time 137646837434 state 0x2 ref 0 00000100:00100000:0.0:1789762835.216858:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762835.216900:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246521344 00000100:00100000:1.0:1789762835.216909:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246521344 00000100:00100000:1.0:1789762835.216939:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137646734264 time 137646837434 state 0x0 ref 1 00000100:00100000:1.0:1789762835.216948:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137846837434 time 137646837434 state 0x1 ref 1 00000100:00100000:2.0:1789762835.258909:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789762835.258935:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254902784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762835.258990:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762835.259022:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902784 00000100:00100000:3.0:1789762835.259032:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902784 00000100:00080000:1.0:1789762835.259064:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762835.259085:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789762835.259094:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254902784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762835.259123:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3827200000 avail 3591385088 00000100:00100000:3.0:1789762835.259176:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254902784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762835.259182:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789762835.259206:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254902784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789762835.322899:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762835.409658:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137846837434 time 137846894084 state 0x0 ref 1 00000100:00100000:1.0:1789762835.409693:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246521344:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762835.409788:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 100663296, mtime: 0x6aad9d13, atime: 0x6aad9d00, ctime: 0x6aad9d13, blocks: 0x30000 00010000:00010000:1.0:1789762835.409799:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.409817:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=137s v=(0 0) 00010000:00010000:1.0:1789762835.409822:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762835.409829:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.409845:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762835.415730:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967410 is committed 00002000:00010000:1.0:1789762835.415833:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:1.0:1789762835.415850:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 196608 -> 198656 00010000:00010000:1.0:1789762835.415862:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.415872:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.415879:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.415884:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762835.415888:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.415894:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.415909:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.415914:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b59af3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762835.415994:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246521344:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6315us (199136us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789762835.416002:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:1.0:1789762835.416012:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137846837434 time 137846894084 state 0x2 ref 0 00000100:00100000:3.0:1789762835.418651:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762835.418704:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246521472 00000100:00100000:1.0:1789762835.418715:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246521472 00000100:00100000:1.0:1789762835.418774:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 137846837434 time 137846894084 state 0x0 ref 1 00000100:00100000:1.0:1789762835.418783:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138046894084 time 137846894084 state 0x1 ref 1 00000100:00100000:2.0:1789762835.609795:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138046894084 time 138047033889 state 0x0 ref 1 00000100:00100000:2.0:1789762835.609823:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c141ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246521472:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762835.609871:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 101711872, mtime: 0x6aad9d13, atime: 0x6aad9d00, ctime: 0x6aad9d13, blocks: 0x30800 00010000:00010000:2.0:1789762835.609878:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.609908:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=138s v=(0 0) 00010000:00010000:2.0:1789762835.609912:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762835.609917:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.609932:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762835.614838:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967411 is committed 00002000:00010000:2.0:1789762835.614899:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:2.0:1789762835.614904:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 198656 -> 200704 00010000:00010000:2.0:1789762835.614912:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.614921:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.614929:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.614937:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762835.614942:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.614952:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.614985:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762835.614991:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b59afa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762835.615045:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c141ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246521472:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5235us (196398us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789762835.615052:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:2.0:1789762835.615057:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138046894084 time 138047033889 state 0x2 ref 0 00000100:00100000:0.0:1789762835.617136:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762835.617177:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246521600 00000100:00100000:2.0:1789762835.617185:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246521600 00000100:00100000:2.0:1789762835.617214:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138046894084 time 138047033889 state 0x0 ref 1 00000100:00100000:2.0:1789762835.617223:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138247033889 time 138047033889 state 0x1 ref 1 00000100:00100000:0.0:1789762835.809961:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138247033889 time 138247195732 state 0x0 ref 1 00000100:00100000:0.0:1789762835.810002:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246521600:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762835.810082:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 102760448, mtime: 0x6aad9d13, atime: 0x6aad9d00, ctime: 0x6aad9d13, blocks: 0x31000 00010000:00010000:0.0:1789762835.810093:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762835.810111:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=138s v=(0 0) 00010000:00010000:0.0:1789762835.810115:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762835.810121:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762835.810135:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762835.815159:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967412 is committed 00002000:00010000:1.0:1789762835.815239:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:1.0:1789762835.815244:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 200704 -> 202752 00010000:00010000:1.0:1789762835.815256:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.815267:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.815275:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.815280:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762835.815284:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.815291:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.815306:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762835.815311:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f287fccb/0x5915dfb1c1b59b01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762835.815403:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246521600:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5421us (198268us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789762835.815412:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:1.0:1789762835.815419:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138247033889 time 138247195732 state 0x2 ref 0 00000100:00100000:3.0:1789762835.817616:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762835.817653:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246521728 00000100:00100000:1.0:1789762835.817661:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246521728 00000100:00100000:1.0:1789762835.817697:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138247033889 time 138247195732 state 0x0 ref 1 00000100:00100000:1.0:1789762835.817708:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138447195732 time 138247195732 state 0x1 ref 1 00000100:00100000:0.0:1789762836.010696:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138447195732 time 138447929612 state 0x0 ref 1 00000100:00080000:1.0:1789762836.010788:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762836.010801:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246521728:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762836.010886:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 103809024, mtime: 0x6aad9d13, atime: 0x6aad9d00, ctime: 0x6aad9d13, blocks: 0x31800 00010000:00010000:0.0:1789762836.010899:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.010920:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=138s v=(0 0) 00010000:00010000:0.0:1789762836.010925:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762836.010934:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.010952:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762836.016129:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967413 is committed 00002000:00010000:0.0:1789762836.016212:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:0.0:1789762836.016220:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789762835 -> 1789762836 00002000:00010000:0.0:1789762836.016223:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789762835 -> 1789762836 00002000:00010000:0.0:1789762836.016225:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 202752 -> 204800 00010000:00010000:0.0:1789762836.016237:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.016246:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.016269:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.016274:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762836.016278:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.016286:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.016303:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.016309:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c97fea9/0x5915dfb1c1b59b08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762836.016396:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246521728:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5681us (198779us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789762836.016404:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:0.0:1789762836.016411:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138447195732 time 138447929612 state 0x2 ref 0 00000100:00100000:3.0:1789762836.017905:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762836.017961:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246521984 00000100:00100000:2.0:1789762836.017971:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246521984 00000100:00080000:1.0:1789762836.018023:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762836.018039:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:2.0:1789762836.018052:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:10427:x1876702246521984:12345-192.168.203.36@tcp:35:dd.500 00000001:00080000:2.0:1789762836.018246:0:12131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967347 00000100:00100000:2.0:1789762836.018334:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:10427:x1876702246521984:12345-192.168.203.36@tcp:35:dd.500 Request processed in 286us (432us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789762836.018340:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000020:00080000:2.0:1789762836.018344:0:12131:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789762836.068169:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762836.068222:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246522240 00000100:00100000:3.0:1789762836.068232:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246522240 00000100:00100000:3.0:1789762836.068288:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:3.0:1789762836.068298:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:10448:x1876702246522240:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762836.068319:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762836.068335:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b59b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894456f expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068431:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068443:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068452:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068463:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068468:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068472:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068568:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b59b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068574:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b59b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068578:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b59b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762836.068585:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 104857600 00010000:00010000:3.0:1789762836.068644:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068650:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068660:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068664:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762836.068667:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068673:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068682:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:3.0:1789762836.068685:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762836.068688:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068692:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3e00/0x5915dfb1c1b59b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068702:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068705:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068710:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068713:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762836.068715:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068726:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068731:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff9b33e2f49700) 00010000:00010000:3.0:1789762836.068732:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762836.068734:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068737:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2e00/0x5915dfb1c1b59b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068807:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e3000/0x5915dfb1c1b59b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894456f expref: 14 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068825:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b59b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894456f expref: 13 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.068833:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:3.0:1789762836.068836:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762836.068838:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f75e2a00, rc 0) 00000100:00100000:3.0:1789762836.068897:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:10448:x1876702246522240:12345-192.168.203.36@tcp:101:dd.500 Request processed in 599us (733us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789762836.068905:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:0.0:1789762836.070304:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762836.070355:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246522368 00000100:00100000:1.0:1789762836.070360:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246522368 00000100:00100000:1.0:1789762836.070403:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1789762836.070410:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246522368:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:1.0:1789762836.070418:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762836.070428:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b59b32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944576 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762836.070445:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 104857600, mtime: 0x6aad9d14, atime: 0x6aad9d00, ctime: 0x6aad9d14, blocks: 0x32000 00010000:00010000:1.0:1789762836.070456:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=138s v=(0 0) 00010000:00010000:1.0:1789762836.070460:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762836.070465:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b59b32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944576 expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.070486:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b59b32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944576 expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.070494:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ef400, rc 0) 00000100:00100000:1.0:1789762836.070521:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246522368:12345-192.168.203.36@tcp:101:dd.500 Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762836.070526:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1789762836.072660:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762836.072712:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246522496 00000100:00100000:2.0:1789762836.072717:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246522496 00000100:00100000:2.0:1789762836.072745:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138447195732 time 138447929612 state 0x0 ref 1 00000100:00100000:2.0:1789762836.072782:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138647929612 time 138447929612 state 0x1 ref 1 00000100:00100000:1.0:1789762836.210808:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138647929612 time 138648045734 state 0x0 ref 1 00000100:00100000:1.0:1789762836.210838:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246522496:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762836.210902:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.210918:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762836.210921:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762836.210927:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.210938:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.215967:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.215979:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.215993:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.215998:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762836.216002:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.216008:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.216022:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762836.216027:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b59b39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762836.216078:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246522496:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5254us (143418us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762836.216085:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:0.0:1789762836.216090:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138647929612 time 138648045734 state 0x2 ref 0 00000100:00100000:0.0:1789762836.218413:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762836.218455:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246522624 00000100:00100000:1.0:1789762836.218463:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246522624 00000100:00100000:1.0:1789762836.218493:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138647929612 time 138648045734 state 0x0 ref 1 00000100:00100000:1.0:1789762836.218508:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138848045734 time 138648045734 state 0x1 ref 1 00010000:00010000:3.0:1789762836.346950:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762836.410885:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138848045734 time 138848124104 state 0x0 ref 1 00000100:00100000:3.0:1789762836.410913:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246522624:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762836.410964:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.410978:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762836.410982:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762836.410987:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.410997:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.414809:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.414820:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.414827:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.414832:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762836.414835:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.414842:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.414871:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.414880:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762836.414931:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246522624:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4031us (196518us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762836.414940:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:3.0:1789762836.414947:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138848045734 time 138848124104 state 0x2 ref 0 00000100:00100000:1.0:1789762836.416913:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762836.416995:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246522752 00000100:00100000:0.0:1789762836.417003:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246522752 00000100:00100000:0.0:1789762836.417034:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 138848045734 time 138848124104 state 0x0 ref 1 00000100:00100000:0.0:1789762836.417043:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139048124104 time 138848124104 state 0x1 ref 1 00000100:00100000:1.0:1789762836.610992:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139048124104 time 139048229824 state 0x0 ref 1 00000100:00100000:1.0:1789762836.611020:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246522752:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762836.611057:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.611071:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762836.611075:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762836.611079:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.611092:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.614699:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.614710:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.614717:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.614722:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da0400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762836.614732:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.614739:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.614770:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762836.614776:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041064476/0x5915dfb1c1b59b47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762836.614827:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246522752:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3821us (197915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762836.614834:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:1.0:1789762836.614839:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139048124104 time 139048229824 state 0x2 ref 0 00000100:00100000:1.0:1789762836.616941:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762836.616996:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246522880 00000100:00100000:0.0:1789762836.617005:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246522880 00000100:00100000:0.0:1789762836.617046:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139048124104 time 139048229824 state 0x0 ref 1 00000100:00100000:0.0:1789762836.617059:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139248229824 time 139048229824 state 0x1 ref 1 00000100:00100000:3.0:1789762836.811094:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139248229824 time 139248327946 state 0x0 ref 1 00000100:00100000:3.0:1789762836.811124:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246522880:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762836.811161:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.811176:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762836.811180:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762836.811185:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.811196:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.814683:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.814699:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.814705:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.814710:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e3e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762836.814713:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.814719:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.814732:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762836.814737:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac75d413/0x5915dfb1c1b59b4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762836.814808:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246522880:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3697us (197866us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762836.814815:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:3.0:1789762836.814820:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139248229824 time 139248327946 state 0x2 ref 0 00000100:00100000:2.0:1789762836.816706:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762836.816740:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523008 00000100:00100000:3.0:1789762836.816747:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523008 00000100:00100000:3.0:1789762836.816798:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139248229824 time 139248327946 state 0x0 ref 1 00000100:00100000:3.0:1789762836.816805:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139448327946 time 139248327946 state 0x1 ref 1 00000100:00100000:2.0:1789762837.011203:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139448327946 time 139448441041 state 0x0 ref 1 00000100:00100000:2.0:1789762837.011231:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523008:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762837.011267:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.011283:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762837.011286:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762837.011292:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.011303:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.014713:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.014723:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.014730:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.014742:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762837.014746:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.014769:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.014782:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.014787:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b59b55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762837.014830:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523008:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3613us (198126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762837.014836:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:2.0:1789762837.014841:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139448327946 time 139448441041 state 0x2 ref 0 00000100:00100000:2.0:1789762837.016902:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762837.016950:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523136 00000100:00100000:1.0:1789762837.016958:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523136 00000100:00100000:1.0:1789762837.016988:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139448327946 time 139448441041 state 0x0 ref 1 00000100:00100000:1.0:1789762837.016996:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139648441041 time 139448441041 state 0x1 ref 1 00000100:00100000:1.0:1789762837.211256:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139648441041 time 139648494617 state 0x0 ref 1 00000100:00100000:1.0:1789762837.211287:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523136:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762837.211326:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.211354:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762837.211357:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762837.211372:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.211385:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.214549:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.214560:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.214567:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.214572:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762837.214576:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.214582:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.214595:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.214599:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59b5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762837.214661:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523136:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3388us (197759us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762837.214668:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:0.0:1789762837.214674:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139648441041 time 139648494617 state 0x2 ref 0 00000100:00100000:2.0:1789762837.216906:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762837.216948:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523264 00000100:00100000:3.0:1789762837.216957:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523264 00000100:00100000:3.0:1789762837.216988:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139648441041 time 139648494617 state 0x0 ref 1 00000100:00100000:3.0:1789762837.216996:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139848494617 time 139648494617 state 0x1 ref 1 00010000:00010000:2.0:1789762837.370881:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762837.411377:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139848494617 time 139848603701 state 0x0 ref 1 00000100:00100000:0.0:1789762837.411404:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523264:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762837.411441:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.411455:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762837.411458:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762837.411463:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.411474:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.414793:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.414809:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.414833:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.414838:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2d400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762837.414842:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.414849:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.414862:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762837.414867:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa496fd/0x5915dfb1c1b59b63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762837.414923:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523264:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3530us (198017us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762837.414933:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:2.0:1789762837.414940:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139848494617 time 139848603701 state 0x2 ref 0 00000100:00100000:2.0:1789762837.417032:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762837.417075:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523392 00000100:00100000:3.0:1789762837.417082:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523392 00000100:00100000:3.0:1789762837.417112:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 139848494617 time 139848603701 state 0x0 ref 1 00000100:00100000:3.0:1789762837.417120:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140048603701 time 139848603701 state 0x1 ref 1 00000100:00100000:0.0:1789762837.611461:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140048603701 time 140048697232 state 0x0 ref 1 00000100:00100000:0.0:1789762837.611492:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523392:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762837.611528:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.611560:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762837.611564:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762837.611569:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.611582:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.614511:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.614520:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.614526:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.614531:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2dc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762837.614534:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.614541:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.614553:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762837.614568:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000519daadc/0x5915dfb1c1b59b6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762837.614615:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523392:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3136us (197582us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762837.614622:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:0.0:1789762837.614627:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140048603701 time 140048697232 state 0x2 ref 0 00000100:00100000:2.0:1789762837.616679:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762837.616716:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523520 00000100:00100000:0.0:1789762837.616723:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523520 00000100:00100000:0.0:1789762837.616766:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140048603701 time 140048697232 state 0x0 ref 1 00000100:00100000:0.0:1789762837.616778:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140248697232 time 140048697232 state 0x1 ref 1 00000100:00100000:1.0:1789762837.811556:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140248697232 time 140248794597 state 0x0 ref 1 00000100:00100000:1.0:1789762837.811584:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523520:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762837.811622:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.811636:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762837.811639:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762837.811644:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.811654:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.814747:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.814782:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.814801:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.814807:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2e800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762837.814811:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.814817:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.814830:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762837.814839:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762837.814899:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523520:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3326us (198219us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762837.814907:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:1.0:1789762837.814912:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140248697232 time 140248794597 state 0x2 ref 0 00000100:00100000:0.0:1789762837.816861:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762837.816944:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523648 00000100:00100000:2.0:1789762837.816953:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523648 00000100:00100000:2.0:1789762837.816984:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140248697232 time 140248794597 state 0x0 ref 1 00000100:00100000:2.0:1789762837.816999:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140448794597 time 140248794597 state 0x1 ref 1 00000100:00100000:1.0:1789762838.011631:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140448794597 time 140448869679 state 0x0 ref 1 00000100:00100000:1.0:1789762838.011679:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523648:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:2.0:1789762838.011686:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762838.011716:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.011738:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762838.011742:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762838.011747:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.011785:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.014884:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.014900:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.014911:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.014920:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2e800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762838.014926:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.014937:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.014957:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.014979:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054863683/0x5915dfb1c1b59b78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762838.015032:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523648:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3386us (198171us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762838.015040:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:1.0:1789762838.015046:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140448794597 time 140448869679 state 0x2 ref 0 00000100:00100000:3.0:1789762838.017099:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762838.017164:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523776 00000100:00100000:0.0:1789762838.017175:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523776 00000100:00100000:0.0:1789762838.017216:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140448794597 time 140448869679 state 0x0 ref 1 00000100:00100000:0.0:1789762838.017228:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140648869679 time 140448869679 state 0x1 ref 1 00000100:00100000:3.0:1789762838.211720:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140648869679 time 140648955494 state 0x0 ref 1 00000100:00100000:3.0:1789762838.211782:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523776:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762838.211821:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.211834:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762838.211838:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762838.211842:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.211853:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.214775:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.214786:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.214793:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.214798:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762838.214802:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.214808:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.214821:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.214840:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b59b7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762838.214888:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246523776:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3146us (197790us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762838.214895:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:1.0:1789762838.214901:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140648869679 time 140648955494 state 0x2 ref 0 00000100:00100000:2.0:1789762838.217133:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762838.217169:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246523904 00000100:00100000:1.0:1789762838.217177:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246523904 00000100:00100000:1.0:1789762838.217208:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140648869679 time 140648955494 state 0x0 ref 1 00000100:00100000:1.0:1789762838.217217:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140848955494 time 140648955494 state 0x1 ref 1 00000100:00100000:2.0:1789762838.330902:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762838.330926:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254903168:0@lo:400:kworker.0 00000100:00100000:2.0:1789762838.330927:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254902912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762838.330975:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254903040:0@lo:400:kworker.0 00000100:00100000:0.0:1789762838.331011:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254903424:0@lo:400:kworker.0 00000100:00100000:1.0:1789762838.331016:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762838.331016:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762838.331025:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762838.331073:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762838.331099:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254903680:0@lo:400:kworker.0 00000100:00100000:2.0:1789762838.331113:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254903296:0@lo:400:kworker.0 00000100:00100000:3.0:1789762838.331118:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254903552:0@lo:400:kworker.0 00000100:00100000:1.0:1789762838.331127:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762838.331136:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903168 00000100:00100000:0.0:1789762838.331143:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903168 00000100:00100000:2.0:1789762838.331169:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762838.331181:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254902912 00000100:00100000:1.0:1789762838.331189:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254902912 00000100:00100000:3.0:1789762838.331191:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903040 00000100:00100000:3.0:1789762838.331197:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903040 00000100:00100000:0.0:1789762838.331200:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903296 00000100:00100000:0.0:1789762838.331205:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903296 00000100:00100000:3.0:1789762838.331239:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789762838.331244:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789762838.331252:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254903040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762838.331254:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789762838.331265:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789762838.331266:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254903168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762838.331272:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254902912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762838.331283:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254903296:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789762838.331297:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42320448 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762838.331307:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254903040:12345-0@lo:400:kworker.0 Request processed in 58us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762838.331314:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789762838.331329:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254903168:12345-0@lo:400:kworker.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762838.331337:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789762838.331369:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903424 00000100:00100000:2.0:1789762838.331370:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254903296:12345-0@lo:400:kworker.0 Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762838.331375:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903424 00000100:00100000:2.0:1789762838.331382:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789762838.331395:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762838.331400:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762838.331403:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762838.331410:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903680 00000100:00100000:3.0:1789762838.331413:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903680 00000100:00100000:2.0:1789762838.331419:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762838.331423:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789762838.331433:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254903424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762838.331444:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789762838.331456:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254902912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762838.331457:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254903680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762838.331471:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254903040:0@lo:400:kworker.0 00000100:00100000:1.0:1789762838.331472:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789762838.331479:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254903424:12345-0@lo:400:kworker.0 Request processed in 46us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762838.331488:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789762838.331508:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254903680:12345-0@lo:400:kworker.0 Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762838.331515:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789762838.331528:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903552 00000100:00100000:2.0:1789762838.331529:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254903296:0@lo:400:kworker.0 00000100:00100000:0.0:1789762838.331533:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903552 00000100:00100000:1.0:1789762838.331538:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254903680:0@lo:400:kworker.0 00000100:00100000:1.0:1789762838.331560:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254903168:0@lo:400:kworker.0 00000100:00100000:2.0:1789762838.331565:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254902912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762838.331581:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789762838.331590:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254903552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762838.331609:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254903424:0@lo:400:kworker.0 00000100:00100000:0.0:1789762838.331629:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254903552:12345-0@lo:400:kworker.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762838.331635:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789762838.331640:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762838.331658:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254903552:0@lo:400:kworker.0 00010000:00010000:1.0:1789762838.394871:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762838.411809:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140848955494 time 140849047836 state 0x0 ref 1 00000100:00100000:3.0:1789762838.411840:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523904:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762838.411883:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.411913:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762838.411916:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762838.411921:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.411932:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.414873:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.414882:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.414889:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.414894:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762838.414897:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.414903:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.414915:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762838.414930:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59b86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762838.414974:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246523904:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3148us (197841us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762838.414980:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:3.0:1789762838.414986:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140848955494 time 140849047836 state 0x2 ref 0 00000100:00100000:0.0:1789762838.416876:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762838.416933:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524032 00000100:00100000:1.0:1789762838.416941:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524032 00000100:00100000:1.0:1789762838.416972:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 140848955494 time 140849047836 state 0x0 ref 1 00000100:00100000:1.0:1789762838.416981:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141049047836 time 140849047836 state 0x1 ref 1 00000100:00100000:1.0:1789762838.611883:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141049047836 time 141049121691 state 0x0 ref 1 00000100:00100000:1.0:1789762838.611912:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246524032:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762838.611949:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.611966:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762838.611971:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762838.611978:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762838.611996:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.615027:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.615039:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.615046:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.615061:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762838.615065:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.615071:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.615087:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.615095:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b59b8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762838.615159:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246524032:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3259us (198283us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762838.615167:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:0.0:1789762838.615173:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141049047836 time 141049121691 state 0x2 ref 0 00000100:00100000:0.0:1789762838.617013:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762838.617062:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524160 00000100:00100000:1.0:1789762838.617069:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524160 00000100:00100000:1.0:1789762838.617115:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141049047836 time 141049121691 state 0x0 ref 1 00000100:00100000:1.0:1789762838.617124:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141249121691 time 141049121691 state 0x1 ref 1 00000100:00100000:2.0:1789762838.812006:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141249121691 time 141249244511 state 0x0 ref 1 00000100:00100000:2.0:1789762838.812032:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246524160:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762838.812069:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762838.812099:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762838.812102:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762838.812107:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762838.812117:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.814880:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.814891:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.814898:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.814915:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2ce00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762838.814920:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.814930:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.814949:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762838.814958:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a58278a/0x5915dfb1c1b59b94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762838.815008:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246524160:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2986us (197994us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762838.815018:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:0.0:1789762838.815025:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141249121691 time 141249244511 state 0x2 ref 0 00000100:00100000:0.0:1789762838.816891:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762838.816924:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524288 00000100:00100000:3.0:1789762838.816933:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524288 00000100:00100000:3.0:1789762838.816963:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141249121691 time 141249244511 state 0x0 ref 1 00000100:00100000:3.0:1789762838.816972:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141449244511 time 141249244511 state 0x1 ref 1 00000100:00100000:2.0:1789762838.915800:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762838.915881:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762838.915883:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524416 00000100:00100000:1.0:1789762838.915895:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524416 00000100:00100000:0.0:1789762838.915930:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524544 00000100:00100000:0.0:1789762838.915938:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524544 00000100:00100000:1.0:1789762838.915953:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:1.0:1789762838.915964:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246524416:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:2.0:1789762838.915995:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762838.916004:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:0.0:1789762838.916018:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246524544:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762838.916027:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246524416:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762838.916034:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:0.0:1789762838.916075:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246524544:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762838.916096:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:0.0:1789762838.919545:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762838.919588:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524800 00000100:00100000:0.0:1789762838.919594:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762838.919595:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524800 00000100:00100000:1.0:1789762838.919640:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524672 00000100:00100000:1.0:1789762838.919646:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524672 00000100:00080000:2.0:1789762838.919678:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762838.919683:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00080000:2.0:1789762838.919685:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762838.919689:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:3.0:1789762838.919699:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246524800:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762838.919705:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2352:x1876702246524672:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:1.0:1789762838.919732:0:6912:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5915dfb1c1b59391 00000100:00080000:1.0:1789762838.919739:0:6912:0:(import.c:65:import_set_state_nolock()) ffff9b33fedbf000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789762838.919745:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246524800:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762838.919776:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00010000:00010000:0.0:1789762838.919779:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789762838.919809:0:6912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967313 00000100:00100000:1.0:1789762838.919938:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+2:2352:x1876702246524672:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 239us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762838.919948:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:0.0:1789762839.012089:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141449244511 time 141449327807 state 0x0 ref 1 00000100:00100000:0.0:1789762839.012114:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246524288:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762839.012151:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.012165:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762839.012169:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762839.012173:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.012184:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.015150:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.015159:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.015165:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.015181:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da5e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762839.015185:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.015191:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.015204:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762839.015209:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7fd38c/0x5915dfb1c1b59b9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762839.015254:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246524288:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3148us (198363us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762839.015261:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:0.0:1789762839.015266:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141449244511 time 141449327807 state 0x2 ref 0 00000100:00100000:2.0:1789762839.017144:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762839.017185:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246524928 00000100:00100000:0.0:1789762839.017193:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246524928 00000100:00100000:0.0:1789762839.017223:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141449244511 time 141449327807 state 0x0 ref 1 00000100:00100000:0.0:1789762839.017231:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141649327807 time 141449327807 state 0x1 ref 1 00000100:00100000:3.0:1789762839.212164:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141649327807 time 141649402159 state 0x0 ref 1 00000100:00100000:3.0:1789762839.212191:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246524928:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762839.212228:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.212255:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762839.212259:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762839.212263:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.212275:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.215243:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.215252:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.215259:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.215264:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762839.215267:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.215274:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.215286:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.215301:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59ba2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762839.215344:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246524928:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3166us (198201us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762839.215364:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 130 00000100:00100000:3.0:1789762839.215369:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141649327807 time 141649402159 state 0x2 ref 0 00000100:00100000:0.0:1789762839.217206:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762839.217249:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525056 00000100:00100000:2.0:1789762839.217257:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525056 00000100:00100000:2.0:1789762839.217287:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141649327807 time 141649402159 state 0x0 ref 1 00000100:00100000:2.0:1789762839.217296:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141849402159 time 141649402159 state 0x1 ref 1 00000100:00100000:1.0:1789762839.412305:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141849402159 time 141849543731 state 0x0 ref 1 00000100:00100000:1.0:1789762839.412332:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246525056:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762839.412379:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.412410:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762839.412414:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762839.412418:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.412429:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762839.415341:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762839.415370:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762839.415381:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762839.415397:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762839.415402:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762839.415410:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762839.415424:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762839.415429:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031cb65a0/0x5915dfb1c1b59ba9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762839.415482:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246525056:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3160us (198275us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762839.415492:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:2.0:1789762839.415499:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141849402159 time 141849543731 state 0x2 ref 0 00000100:00100000:0.0:1789762839.417599:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762839.417658:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525184 00000100:00100000:1.0:1789762839.417666:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525184 00000100:00100000:1.0:1789762839.417696:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 141849402159 time 141849543731 state 0x0 ref 1 00000100:00100000:1.0:1789762839.417704:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142049543731 time 141849543731 state 0x1 ref 1 00010000:00010000:3.0:1789762839.418894:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762839.612370:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142049543731 time 142049607776 state 0x0 ref 1 00000100:00100000:1.0:1789762839.612400:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525184:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762839.612438:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.612453:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762839.612456:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762839.612461:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.612473:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.615438:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.615449:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.615456:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.615460:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762839.615464:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.615470:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.615483:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762839.615489:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ccfa539/0x5915dfb1c1b59bb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762839.615536:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525184:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3151us (197938us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762839.615543:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:1.0:1789762839.615556:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142049543731 time 142049607776 state 0x2 ref 0 00000100:00100000:2.0:1789762839.617522:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762839.617562:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525312 00000100:00100000:3.0:1789762839.617571:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525312 00000100:00100000:3.0:1789762839.617611:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142049543731 time 142049607776 state 0x0 ref 1 00000100:00100000:3.0:1789762839.617624:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142249607776 time 142049607776 state 0x1 ref 1 00000100:00100000:3.0:1789762839.812490:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142249607776 time 142249723706 state 0x0 ref 1 00000100:00100000:3.0:1789762839.812531:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246525312:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762839.812584:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.812602:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762839.812606:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762839.812611:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.812626:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.815656:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.815667:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.815675:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.815680:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762839.815684:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.815691:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.815706:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762839.815712:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bb7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762839.815798:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246525312:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3288us (198275us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762839.815809:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 133 00000100:00100000:3.0:1789762839.815822:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142249607776 time 142249723706 state 0x2 ref 0 00000100:00100000:2.0:1789762839.817730:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762839.817831:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525440 00000100:00100000:1.0:1789762839.817842:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525440 00000100:00100000:1.0:1789762839.817886:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142249607776 time 142249723706 state 0x0 ref 1 00000100:00100000:1.0:1789762839.817896:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142449723706 time 142249723706 state 0x1 ref 1 00000100:00100000:0.0:1789762840.012672:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142449723706 time 142449905802 state 0x0 ref 1 00000100:00100000:0.0:1789762840.012723:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525440:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:2.0:1789762840.012802:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762840.012814:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.012833:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762840.012837:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762840.012843:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.012858:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.016214:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.016229:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.016236:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.016241:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762840.016244:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.016267:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.016283:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.016287:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762840.016368:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525440:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3674us (198641us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762840.016382:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 134 00000100:00100000:0.0:1789762840.016389:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142449723706 time 142449905802 state 0x2 ref 0 00000100:00100000:2.0:1789762840.018266:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762840.018357:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525568 00000100:00100000:1.0:1789762840.018365:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525568 00000100:00100000:1.0:1789762840.018401:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142449723706 time 142449905802 state 0x0 ref 1 00000100:00100000:1.0:1789762840.018410:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142649905802 time 142449905802 state 0x1 ref 1 00000100:00100000:2.0:1789762840.212815:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142649905802 time 142650045107 state 0x0 ref 1 00000100:00100000:2.0:1789762840.212843:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246525568:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762840.212895:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.212910:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762840.212914:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762840.212921:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762840.212936:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.215912:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.215923:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.215930:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.215936:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4643400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762840.215939:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.215945:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.215958:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.215963:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002589d149/0x5915dfb1c1b59bc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762840.216022:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246525568:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3192us (197757us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762840.216030:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 135 00000100:00100000:3.0:1789762840.216042:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142649905802 time 142650045107 state 0x2 ref 0 00000100:00100000:0.0:1789762840.217888:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762840.217921:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525696 00000100:00100000:3.0:1789762840.217928:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525696 00000100:00100000:3.0:1789762840.217956:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142649905802 time 142650045107 state 0x0 ref 1 00000100:00100000:3.0:1789762840.217963:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142850045107 time 142650045107 state 0x1 ref 1 00000100:00100000:3.0:1789762840.378914:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762840.378974:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762840.379022:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903808 00000100:00100000:1.0:1789762840.379033:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903808 00000100:00080000:2.0:1789762840.379069:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762840.379096:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789762840.379107:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254903808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762840.379133:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:1.0:1789762840.379174:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254903808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762840.379181:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789762840.379216:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762840.412901:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142850045107 time 142850138559 state 0x0 ref 1 00000100:00100000:0.0:1789762840.412931:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525696:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762840.412971:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.412987:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762840.412992:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762840.412999:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762840.413030:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.415951:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.415961:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.415969:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.415983:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762840.415986:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.415992:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.416005:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.416010:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef321370/0x5915dfb1c1b59bcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762840.416059:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525696:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3142us (198173us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762840.416069:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:1.0:1789762840.416074:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142850045107 time 142850138559 state 0x2 ref 0 00000100:00100000:1.0:1789762840.418079:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762840.418130:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525824 00000100:00100000:0.0:1789762840.418139:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525824 00000100:00100000:0.0:1789762840.418174:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 142850045107 time 142850138559 state 0x0 ref 1 00000100:00100000:0.0:1789762840.418185:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143050138559 time 142850138559 state 0x1 ref 1 00010000:00010000:2.0:1789762840.442885:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762840.613002:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143050138559 time 143050239754 state 0x0 ref 1 00000100:00100000:3.0:1789762840.613036:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246525824:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762840.613082:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.613098:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762840.613103:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762840.613110:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762840.613126:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.616377:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.616389:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.616400:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.616417:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762840.616422:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.616433:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.616451:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.616457:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b74be33/0x5915dfb1c1b59bd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762840.616507:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246525824:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3487us (198427us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762840.616513:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:1.0:1789762840.616519:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143050138559 time 143050239754 state 0x2 ref 0 00000100:00100000:3.0:1789762840.618964:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762840.619019:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246525952 00000100:00100000:2.0:1789762840.619028:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246525952 00000100:00100000:2.0:1789762840.619060:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143050138559 time 143050239754 state 0x0 ref 1 00000100:00100000:2.0:1789762840.619069:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143250239754 time 143050239754 state 0x1 ref 1 00000100:00100000:1.0:1789762840.813085:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143250239754 time 143250323451 state 0x0 ref 1 00000100:00100000:1.0:1789762840.813111:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525952:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762840.813147:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.813162:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762840.813176:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762840.813181:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.813193:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.815992:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.816004:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.816010:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.816015:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da0e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762840.816018:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.816025:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.816038:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762840.816043:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59bda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762840.816103:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246525952:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3002us (197140us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762840.816110:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 138 00000100:00100000:1.0:1789762840.816115:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143250239754 time 143250323451 state 0x2 ref 0 00000100:00100000:3.0:1789762840.818209:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762840.818247:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526080 00000100:00100000:1.0:1789762840.818256:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526080 00000100:00100000:1.0:1789762840.818286:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143250239754 time 143250323451 state 0x0 ref 1 00000100:00100000:1.0:1789762840.818294:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143450323451 time 143250323451 state 0x1 ref 1 00000100:00100000:1.0:1789762841.013141:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143450323451 time 143450376221 state 0x0 ref 1 00000100:00100000:1.0:1789762841.013171:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526080:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762841.013208:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.013222:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762841.013226:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762841.013230:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.013240:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.016107:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.016133:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.016143:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.016152:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da0e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762841.016157:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.016167:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.016182:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762841.016188:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1d44ba/0x5915dfb1c1b59be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762841.016234:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526080:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3076us (198026us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762841.016242:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 139 00000100:00100000:1.0:1789762841.016247:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143450323451 time 143450376221 state 0x2 ref 0 00000100:00100000:2.0:1789762841.018119:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762841.018157:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526208 00000100:00100000:1.0:1789762841.018172:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526208 00000100:00100000:1.0:1789762841.018201:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143450323451 time 143450376221 state 0x0 ref 1 00000100:00100000:1.0:1789762841.018210:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143650376221 time 143450376221 state 0x1 ref 1 00000100:00100000:3.0:1789762841.213216:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143650376221 time 143650454801 state 0x0 ref 1 00000100:00100000:3.0:1789762841.213256:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246526208:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762841.213293:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.213307:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762841.213310:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762841.213315:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.213326:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.216084:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.216093:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.216099:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.216103:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762841.216107:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.216113:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.216132:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762841.216138:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59be8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762841.216188:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246526208:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2941us (198069us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762841.216195:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 140 00000100:00100000:3.0:1789762841.216200:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143650376221 time 143650454801 state 0x2 ref 0 00000100:00100000:2.0:1789762841.218136:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762841.218177:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526336 00000100:00100000:1.0:1789762841.218184:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526336 00000100:00100000:1.0:1789762841.218213:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143650376221 time 143650454801 state 0x0 ref 1 00000100:00100000:1.0:1789762841.218221:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143850454801 time 143650454801 state 0x1 ref 1 00000001:00080000:0.0:1789762841.403698:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000100:00100000:0.0:1789762841.413290:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143850454801 time 143850530587 state 0x0 ref 1 00000100:00100000:0.0:1789762841.413315:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526336:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762841.413367:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.413385:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762841.413389:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762841.413395:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.413409:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.416143:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.416168:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.416177:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.416184:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762841.416189:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.416199:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.416216:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.416225:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762841.416279:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526336:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2974us (198143us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762841.416290:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:0.0:1789762841.416297:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143850454801 time 143850530587 state 0x2 ref 0 00000100:00100000:0.0:1789762841.418248:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762841.418303:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526464 00000100:00100000:1.0:1789762841.418311:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526464 00000100:00100000:1.0:1789762841.418356:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 143850454801 time 143850530587 state 0x0 ref 1 00000100:00100000:1.0:1789762841.418365:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144050530587 time 143850530587 state 0x1 ref 1 00010000:00010000:1.0:1789762841.466838:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762841.613373:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144050530587 time 144050607801 state 0x0 ref 1 00000100:00100000:2.0:1789762841.613402:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246526464:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762841.613446:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.613459:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762841.613476:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762841.613482:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.613495:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.616935:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.616946:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.616954:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.616959:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c0031a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762841.616962:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.616968:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.616981:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762841.616986:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c07644/0x5915dfb1c1b59bf6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762841.617069:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246526464:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3679us (198819us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762841.617080:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:2.0:1789762841.617087:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144050530587 time 144050607801 state 0x2 ref 0 00000100:00100000:2.0:1789762841.618998:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762841.619034:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526592 00000100:00100000:3.0:1789762841.619043:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526592 00000100:00100000:3.0:1789762841.619082:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144050530587 time 144050607801 state 0x0 ref 1 00000100:00100000:3.0:1789762841.619094:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144250607801 time 144050607801 state 0x1 ref 1 00000100:00100000:0.0:1789762841.813484:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144250607801 time 144250722056 state 0x0 ref 1 00000100:00100000:0.0:1789762841.813513:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526592:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762841.813551:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.813565:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762841.813568:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762841.813573:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.813584:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.816950:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.816970:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.816987:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.816994:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762841.816999:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.817024:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.817044:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762841.817050:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b59bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762841.817119:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526592:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3616us (198116us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762841.817128:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 143 00000100:00100000:0.0:1789762841.817135:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144250607801 time 144250722056 state 0x2 ref 0 00000100:00100000:2.0:1789762841.819182:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762841.819218:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526720 00000100:00100000:0.0:1789762841.819226:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526720 00000100:00100000:0.0:1789762841.819260:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144250607801 time 144250722056 state 0x0 ref 1 00000100:00100000:0.0:1789762841.819268:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144450722056 time 144250722056 state 0x1 ref 1 00000100:00100000:3.0:1789762842.013583:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144450722056 time 144450819279 state 0x0 ref 1 00000100:00100000:3.0:1789762842.013638:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246526720:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:2.0:1789762842.013671:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762842.013682:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.013700:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762842.013706:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762842.013712:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.013740:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.016879:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.016891:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.016901:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.016909:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762842.016913:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.016922:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.016939:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.016947:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a130ec/0x5915dfb1c1b59c04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.017018:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246526720:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3416us (197838us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762842.017028:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 144 00000100:00100000:3.0:1789762842.017034:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144450722056 time 144450819279 state 0x2 ref 0 00000100:00100000:2.0:1789762842.018896:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762842.018939:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526848 00000100:00100000:3.0:1789762842.018948:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526848 00000100:00100000:3.0:1789762842.018982:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144450722056 time 144450819279 state 0x0 ref 1 00000100:00100000:3.0:1789762842.018993:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144650819279 time 144450819279 state 0x1 ref 1 00000100:00100000:1.0:1789762842.213675:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144650819279 time 144650913686 state 0x0 ref 1 00000100:00100000:1.0:1789762842.213703:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526848:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762842.213740:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.213782:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.213786:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.213791:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.213803:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.216677:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.216689:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.216695:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.216700:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762842.216703:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.216710:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.216728:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.216733:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762842.216806:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246526848:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3114us (197909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762842.216813:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 145 00000100:00100000:1.0:1789762842.216826:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144650819279 time 144650913686 state 0x2 ref 0 00000100:00100000:1.0:1789762842.218909:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762842.218963:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246526976 00000100:00100000:0.0:1789762842.218972:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246526976 00000100:00100000:0.0:1789762842.219012:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144650819279 time 144650913686 state 0x0 ref 1 00000100:00100000:0.0:1789762842.219024:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144850913686 time 144650913686 state 0x1 ref 1 00000100:00100000:1.0:1789762842.413790:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144850913686 time 144850992767 state 0x0 ref 1 00000100:00100000:1.0:1789762842.413832:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246526976:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762842.413868:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.413885:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.413890:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.413897:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.413913:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.416969:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.416985:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.416995:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.417003:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762842.417008:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.417019:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.417072:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762842.417080:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b59c12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762842.417137:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246526976:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3329us (198228us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762842.417147:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:3.0:1789762842.417154:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144850913686 time 144850992767 state 0x2 ref 0 00000100:00100000:2.0:1789762842.419016:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762842.419050:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246527104 00000100:00100000:3.0:1789762842.419059:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246527104 00000100:00100000:3.0:1789762842.419092:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 144850913686 time 144850992767 state 0x0 ref 1 00000100:00100000:3.0:1789762842.419101:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145050992767 time 144850992767 state 0x1 ref 1 00010000:00010000:0.0:1789762842.490922:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762842.613854:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145050992767 time 145051091807 state 0x0 ref 1 00000100:00100000:2.0:1789762842.613882:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527104:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762842.613919:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.613933:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762842.613937:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762842.613942:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762842.613954:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.616728:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.616745:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.616777:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.616782:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4dea000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762842.616786:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.616792:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.616805:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.616810:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c60d2e/0x5915dfb1c1b59c19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.616857:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527104:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2989us (197844us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762842.616864:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:0.0:1789762842.616869:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145050992767 time 145051091807 state 0x2 ref 0 00000100:00100000:3.0:1789762842.618678:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762842.618719:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246527232 00000100:00100000:1.0:1789762842.618728:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246527232 00000100:00100000:1.0:1789762842.618796:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145050992767 time 145051091807 state 0x0 ref 1 00000100:00100000:1.0:1789762842.618806:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145251091807 time 145051091807 state 0x1 ref 1 00000100:00100000:1.0:1789762842.813902:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145251091807 time 145251140714 state 0x0 ref 1 00000100:00100000:1.0:1789762842.813929:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246527232:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762842.813966:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.813996:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.814000:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762842.814013:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762842.814027:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.817156:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.817173:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.817181:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.817186:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762842.817189:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.817195:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.817208:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762842.817213:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000284ec51d/0x5915dfb1c1b59c20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762842.817261:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246527232:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3344us (198583us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762842.817267:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 148 00000100:00100000:0.0:1789762842.817273:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145251091807 time 145251140714 state 0x2 ref 0 00000100:00100000:3.0:1789762842.819411:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762842.819471:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246527360 00000100:00100000:1.0:1789762842.819480:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246527360 00000100:00100000:1.0:1789762842.819515:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145251091807 time 145251140714 state 0x0 ref 1 00000100:00100000:1.0:1789762842.819526:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145451140714 time 145251140714 state 0x1 ref 1 00000100:00100000:2.0:1789762843.013990:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145451140714 time 145451226307 state 0x0 ref 1 00000100:00100000:2.0:1789762843.014041:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527360:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762843.014080:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.014093:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762843.014096:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762843.014101:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.014111:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.017370:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.017393:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.017400:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.017406:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2fe00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762843.017409:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.017415:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.017429:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.017434:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4827d6/0x5915dfb1c1b59c27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762843.017483:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527360:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3454us (198073us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762843.017490:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 149 00000100:00100000:0.0:1789762843.017495:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145451140714 time 145451226307 state 0x2 ref 0 00000100:00100000:2.0:1789762843.019478:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762843.019512:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246527488 00000100:00100000:0.0:1789762843.019526:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246527488 00000100:00100000:0.0:1789762843.019553:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145451140714 time 145451226307 state 0x0 ref 1 00000100:00100000:0.0:1789762843.019561:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145651226307 time 145451226307 state 0x1 ref 1 00000100:00100000:0.0:1789762843.214049:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145651226307 time 145651287441 state 0x0 ref 1 00000100:00100000:0.0:1789762843.214077:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246527488:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762843.214113:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.214128:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762843.214132:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762843.214136:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.214147:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.216979:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.216990:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.216996:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.217017:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de9400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762843.217021:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.217027:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.217039:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.217044:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be947ac4/0x5915dfb1c1b59c2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762843.217092:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246527488:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3028us (197614us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762843.217099:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 150 00000100:00100000:0.0:1789762843.217105:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145651226307 time 145651287441 state 0x2 ref 0 00000100:00100000:1.0:1789762843.219228:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762843.219266:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246527616 00000100:00100000:0.0:1789762843.219274:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246527616 00000100:00100000:0.0:1789762843.219305:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145651226307 time 145651287441 state 0x0 ref 1 00000100:00100000:0.0:1789762843.219314:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145851287441 time 145651287441 state 0x1 ref 1 00000100:00100000:3.0:1789762843.414197:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145851287441 time 145851435499 state 0x0 ref 1 00000100:00100000:3.0:1789762843.414227:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527616:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762843.414263:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762843.414276:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762843.414293:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762843.414298:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762843.414309:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.416694:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.416716:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.416723:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.416728:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762843.416732:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.416737:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.416778:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762843.416784:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087cad7e0/0x5915dfb1c1b59c35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762843.416832:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527616:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2620us (197605us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762843.416838:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:0.0:1789762843.416844:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145851287441 time 145851435499 state 0x2 ref 0 00000100:00100000:1.0:1789762843.418820:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762843.418854:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246527744 00000100:00100000:0.0:1789762843.418866:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246527744 00000100:00100000:0.0:1789762843.418894:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 145851287441 time 145851435499 state 0x0 ref 1 00000100:00100000:0.0:1789762843.418902:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146051435499 time 145851435499 state 0x1 ref 1 00000100:00100000:1.0:1789762843.450917:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254904192:0@lo:400:kworker.0 00000100:00100000:2.0:1789762843.450917:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254903936:0@lo:400:kworker.0 00000100:00100000:0.0:1789762843.450951:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254904064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762843.450954:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254904320:0@lo:400:kworker.0 00000100:00100000:1.0:1789762843.451002:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762843.451004:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762843.451016:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762843.451032:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904192 00000100:00100000:3.0:1789762843.451041:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904192 00000100:00100000:0.0:1789762843.451077:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254904576:0@lo:400:kworker.0 00000100:00100000:2.0:1789762843.451084:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254904448:0@lo:400:kworker.0 00000100:00100000:1.0:1789762843.451086:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254904704:0@lo:400:kworker.0 00000100:00100000:3.0:1789762843.451093:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789762843.451105:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254904192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762843.451120:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762843.451141:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762843.451151:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904064 00000100:00100000:1.0:1789762843.451156:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904064 00000100:00100000:0.0:1789762843.451168:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904576 00000100:00100000:0.0:1789762843.451173:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904576 00000100:00100000:3.0:1789762843.451179:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254904192:12345-0@lo:400:kworker.0 Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762843.451186:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789762843.451202:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254903936 00000100:00100000:2.0:1789762843.451207:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254903936 00000100:00100000:1.0:1789762843.451212:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789762843.451215:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789762843.451227:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254904064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762843.451229:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254904576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762843.451246:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00002000:00000024:1.0:1789762843.451253:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762843.451254:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762843.451260:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254903936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762843.451281:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254904576:12345-0@lo:400:kworker.0 Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762843.451286:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762843.451306:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904320 00000100:00100000:3.0:1789762843.451310:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904320 00000100:00100000:1.0:1789762843.451311:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254904064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762843.451331:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254903936:12345-0@lo:400:kworker.0 Request processed in 62us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762843.451342:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789762843.451350:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762843.451354:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789762843.451359:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789762843.451369:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254904320:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762843.451386:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762843.451394:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762843.451394:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904448 00000100:00100000:0.0:1789762843.451397:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254904192:0@lo:400:kworker.0 00000100:00100000:2.0:1789762843.451406:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904448 00000100:00100000:3.0:1789762843.451411:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254904320:12345-0@lo:400:kworker.0 Request processed in 45us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762843.451427:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789762843.451445:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904704 00000100:00100000:1.0:1789762843.451450:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904704 00000100:00100000:2.0:1789762843.451456:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789762843.451468:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254904448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762843.451474:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789762843.451485:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254904064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762843.451487:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254904704:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762843.451491:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762843.451505:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254904576:0@lo:400:kworker.0 00000100:00100000:2.0:1789762843.451512:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254904448:12345-0@lo:400:kworker.0 Request processed in 48us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762843.451519:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789762843.451550:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254904704:12345-0@lo:400:kworker.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762843.451556:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254904448:0@lo:400:kworker.0 00000100:00100000:3.0:1789762843.451560:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789762843.451583:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254904704:0@lo:400:kworker.0 00000100:00100000:2.0:1789762843.451583:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254903936:0@lo:400:kworker.0 00000100:00100000:3.0:1789762843.451603:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254904320:0@lo:400:kworker.0 00010000:00010000:3.0:1789762843.514906:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762843.614281:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146051435499 time 146051519324 state 0x0 ref 1 00000100:00100000:1.0:1789762843.614307:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246527744:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762843.614355:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.614369:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762843.614373:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.614378:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.614390:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.617549:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.617560:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.617567:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.617572:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762843.617576:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.617582:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.617595:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762843.617613:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b59c3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762843.617660:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246527744:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3364us (198841us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762843.617667:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 152 00000100:00100000:2.0:1789762843.617695:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146051435499 time 146051519324 state 0x2 ref 0 00000100:00100000:2.0:1789762843.619848:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762843.619921:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246527872 00000100:00100000:0.0:1789762843.619930:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246527872 00000100:00100000:0.0:1789762843.619962:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146051435499 time 146051519324 state 0x0 ref 1 00000100:00100000:0.0:1789762843.619971:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146251519324 time 146051519324 state 0x1 ref 1 00000100:00100000:1.0:1789762843.814365:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146251519324 time 146251603006 state 0x0 ref 1 00000100:00100000:1.0:1789762843.814394:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527872:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762843.814431:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.814463:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.814466:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762843.814471:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.814482:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.817539:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.817550:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.817557:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.817562:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762843.817565:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.817571:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.817584:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762843.817599:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762843.817647:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246527872:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3265us (197798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762843.817656:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 153 00000100:00100000:1.0:1789762843.817662:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146251519324 time 146251603006 state 0x2 ref 0 00000100:00100000:3.0:1789762843.819878:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762843.819922:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528000 00000100:00100000:0.0:1789762843.819930:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528000 00000100:00100000:0.0:1789762843.819970:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146251519324 time 146251603006 state 0x0 ref 1 00000100:00100000:0.0:1789762843.819979:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146451603006 time 146251603006 state 0x1 ref 1 00000100:00100000:2.0:1789762844.014478:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146451603006 time 146451715111 state 0x0 ref 1 00000100:00100000:2.0:1789762844.014519:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246528000:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:1.0:1789762844.014540:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762844.014556:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.014571:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762844.014574:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762844.014580:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.014590:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.017046:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.017066:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.017073:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.017079:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762844.017082:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.017089:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.017102:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.017106:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81fe260/0x5915dfb1c1b59c4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762844.017153:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246528000:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2661us (197276us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762844.017161:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 154 00000100:00100000:0.0:1789762844.017167:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146451603006 time 146451715111 state 0x2 ref 0 00000100:00100000:2.0:1789762844.019125:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762844.019169:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528128 00000100:00100000:1.0:1789762844.019177:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528128 00000100:00100000:1.0:1789762844.019206:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146451603006 time 146451715111 state 0x0 ref 1 00000100:00100000:1.0:1789762844.019214:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146651715111 time 146451715111 state 0x1 ref 1 00000100:00100000:3.0:1789762844.035807:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762844.035849:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762844.035880:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762844.035897:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528384 00000100:00100000:1.0:1789762844.035899:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528256 00000100:00100000:1.0:1789762844.035909:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528256 00000100:00100000:0.0:1789762844.035917:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528384 00000100:00100000:2.0:1789762844.035943:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528512 00000100:00100000:2.0:1789762844.035959:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528512 00000100:00100000:1.0:1789762844.035974:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00080000:3.0:1789762844.035974:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762844.035982:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:1.0:1789762844.035989:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246528256:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762844.035999:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246528384:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762844.036011:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:2.0:1789762844.036023:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246528512:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762844.036066:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246528384:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762844.036069:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246528512:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 46us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762844.036071:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246528256:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762844.036084:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:0.0:1789762844.036096:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:1.0:1789762844.036098:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:1.0:1789762844.214524:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146651715111 time 146651761842 state 0x0 ref 1 00000100:00100000:1.0:1789762844.214552:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246528128:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762844.214589:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.214621:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.214625:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762844.214631:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.214642:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.217372:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.217382:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.217389:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.217394:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762844.217397:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.217404:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.217417:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762844.217432:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762844.217479:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246528128:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2940us (198355us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762844.217486:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:1.0:1789762844.217491:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146651715111 time 146651761842 state 0x2 ref 0 00000100:00100000:3.0:1789762844.219897:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762844.219930:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528640 00000100:00100000:1.0:1789762844.219939:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528640 00000100:00100000:1.0:1789762844.219970:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146651715111 time 146651761842 state 0x0 ref 1 00000100:00100000:1.0:1789762844.219979:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146851761842 time 146651761842 state 0x1 ref 1 00000100:00100000:2.0:1789762844.414603:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146851761842 time 146851841371 state 0x0 ref 1 00000100:00100000:2.0:1789762844.414631:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246528640:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762844.414667:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.414681:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762844.414685:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762844.414689:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.414700:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.417462:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.417471:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.417477:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.417496:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762844.417499:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.417506:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.417523:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762844.417531:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c90d7d/0x5915dfb1c1b59c58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762844.417584:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246528640:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2966us (197687us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762844.417592:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:2.0:1789762844.417597:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146851761842 time 146851841371 state 0x2 ref 0 00000100:00100000:2.0:1789762844.419801:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762844.419854:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528768 00000100:00100000:0.0:1789762844.419863:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528768 00000100:00100000:0.0:1789762844.419898:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 146851761842 time 146851841371 state 0x0 ref 1 00000100:00100000:0.0:1789762844.419909:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147051841371 time 146851841371 state 0x1 ref 1 00000001:00100000:2.0:1789762844.475647:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:2.0:1789762844.475656:0:7983:0:(genops.c:885:class_export_put()) final put ffff9b33f46c1800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:3.0:1789762844.475702:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b33f46c1800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 for lustre-OST0001 00000020:00000080:3.0:1789762844.475770:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b33fedbf000 for lustre-OST0001 00010000:00010000:2.0:1789762844.538904:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762844.614677:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147051841371 time 147051913906 state 0x0 ref 1 00000100:00100000:0.0:1789762844.614708:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246528768:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762844.614776:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.614795:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762844.614799:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762844.614806:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.614822:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.618323:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.618354:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.618363:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.618370:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da2000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762844.618375:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.618385:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.618402:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.618410:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762844.618464:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246528768:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3770us (198662us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762844.618475:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:0.0:1789762844.618482:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147051841371 time 147051913906 state 0x2 ref 0 00000100:00100000:3.0:1789762844.620449:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762844.620489:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246528896 00000100:00100000:1.0:1789762844.620497:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246528896 00000100:00100000:1.0:1789762844.620528:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147051841371 time 147051913906 state 0x0 ref 1 00000100:00100000:1.0:1789762844.620536:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147251913906 time 147051913906 state 0x1 ref 1 00000100:00100000:0.0:1789762844.814797:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147251913906 time 147252034999 state 0x0 ref 1 00000100:00100000:0.0:1789762844.814838:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246528896:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762844.814878:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.814904:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762844.814907:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762844.814913:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.814924:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.817867:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.817877:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.817884:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.817889:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da2000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762844.817892:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.817899:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.817920:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762844.817925:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762844.817975:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246528896:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3146us (197527us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762844.817982:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:0.0:1789762844.817987:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147251913906 time 147252034999 state 0x2 ref 0 00000100:00100000:3.0:1789762844.819963:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762844.820036:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529024 00000100:00100000:2.0:1789762844.820045:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529024 00000100:00100000:2.0:1789762844.820075:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147251913906 time 147252034999 state 0x0 ref 1 00000100:00100000:2.0:1789762844.820092:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147452034999 time 147252034999 state 0x1 ref 1 00000100:00100000:1.0:1789762845.014881:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147452034999 time 147452119052 state 0x0 ref 1 00000100:00100000:1.0:1789762845.014907:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246529024:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762845.014943:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.014957:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762845.014980:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762845.014985:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.014996:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.018497:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.018508:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.018516:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.018522:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762845.018525:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.018531:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.018544:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.018549:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762845.018609:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246529024:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3714us (198647us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762845.018617:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:1.0:1789762845.018622:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147452034999 time 147452119052 state 0x2 ref 0 00000100:00100000:3.0:1789762845.020731:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762845.020795:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529152 00000100:00100000:0.0:1789762845.020804:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529152 00000100:00100000:0.0:1789762845.020842:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147452034999 time 147452119052 state 0x0 ref 1 00000100:00100000:0.0:1789762845.020854:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147652119052 time 147452119052 state 0x1 ref 1 00000100:00100000:3.0:1789762845.215011:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147652119052 time 147652248709 state 0x0 ref 1 00000100:00100000:3.0:1789762845.215039:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529152:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762845.215082:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.215100:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.215120:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762845.215128:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.215140:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.218011:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.218022:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.218029:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.218034:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2e400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762845.218037:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.218043:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.218055:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762845.218060:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c5b6d84/0x5915dfb1c1b59c74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762845.218113:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529152:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3087us (197382us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762845.218121:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:3.0:1789762845.218127:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147652119052 time 147652248709 state 0x2 ref 0 00000100:00100000:3.0:1789762845.220357:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762845.220409:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529280 00000100:00100000:0.0:1789762845.220418:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529280 00000100:00100000:0.0:1789762845.220469:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147652119052 time 147652248709 state 0x0 ref 1 00000100:00100000:0.0:1789762845.220481:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147852248709 time 147652248709 state 0x1 ref 1 00000100:00100000:0.0:1789762845.415084:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147852248709 time 147852319702 state 0x0 ref 1 00000100:00100000:0.0:1789762845.415116:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246529280:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762845.415158:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.415188:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762845.415193:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762845.415200:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.415215:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.418033:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.418046:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.418055:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.418063:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da2000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762845.418068:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.418077:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.418096:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762845.418116:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59c7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762845.418170:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246529280:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3068us (197812us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762845.418181:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:0.0:1789762845.418189:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147852248709 time 147852319702 state 0x2 ref 0 00000100:00100000:3.0:1789762845.420429:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762845.420506:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529408 00000100:00100000:1.0:1789762845.420514:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529408 00000100:00100000:1.0:1789762845.420545:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 147852248709 time 147852319702 state 0x0 ref 1 00000100:00100000:1.0:1789762845.420554:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148052319702 time 147852319702 state 0x1 ref 1 00000100:00100000:3.0:1789762845.498958:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254904832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762845.499025:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762845.499062:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904832 00000100:00100000:1.0:1789762845.499070:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904832 00000100:00080000:0.0:1789762845.499108:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762845.499143:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789762845.499155:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254904832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762845.499186:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:1.0:1789762845.499235:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254904832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762845.499240:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789762845.499287:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254904832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762845.562847:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762845.615175:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148052319702 time 148052414076 state 0x0 ref 1 00000100:00100000:1.0:1789762845.615203:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246529408:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762845.615242:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.615273:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762845.615277:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762845.615281:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.615293:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.618415:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.618426:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.618432:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.618438:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762845.618441:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.618448:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.618460:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762845.618476:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762845.618525:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246529408:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3335us (198097us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762845.618532:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:1.0:1789762845.618537:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148052319702 time 148052414076 state 0x2 ref 0 00000100:00100000:3.0:1789762845.620587:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762845.620640:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529536 00000100:00100000:1.0:1789762845.620649:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529536 00000100:00100000:1.0:1789762845.620684:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148052319702 time 148052414076 state 0x0 ref 1 00000100:00100000:1.0:1789762845.620695:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148252414076 time 148052414076 state 0x1 ref 1 00000100:00100000:2.0:1789762845.815274:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148252414076 time 148252509123 state 0x0 ref 1 00000100:00100000:2.0:1789762845.815319:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529536:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762845.815357:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.815372:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762845.815375:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762845.815380:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.815391:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.818154:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.818165:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.818172:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.818177:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d6b400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762845.818180:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.818194:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.818208:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762845.818213:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d11498d/0x5915dfb1c1b59c89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762845.818271:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529536:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2978us (197689us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762845.818281:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 163 00000100:00100000:2.0:1789762845.818288:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148252414076 time 148252509123 state 0x2 ref 0 00000100:00100000:2.0:1789762845.820341:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762845.820404:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529664 00000100:00100000:0.0:1789762845.820414:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529664 00000100:00100000:0.0:1789762845.820450:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148252414076 time 148252509123 state 0x0 ref 1 00000100:00100000:0.0:1789762845.820461:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148452509123 time 148252509123 state 0x1 ref 1 00000100:00100000:0.0:1789762846.015360:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148452509123 time 148452597653 state 0x0 ref 1 00000100:00100000:0.0:1789762846.015411:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529664:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:3.0:1789762846.015437:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762846.015457:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.015476:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762846.015481:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762846.015487:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.015501:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.018582:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.018593:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.018600:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.018606:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762846.018609:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.018627:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.018641:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.018646:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b219f58/0x5915dfb1c1b59c90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762846.018700:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529664:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3322us (198364us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762846.018709:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:1.0:1789762846.018715:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148452509123 time 148452597653 state 0x2 ref 0 00000100:00100000:0.0:1789762846.020792:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762846.020826:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529792 00000100:00100000:1.0:1789762846.020835:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529792 00000100:00100000:1.0:1789762846.020866:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148452509123 time 148452597653 state 0x0 ref 1 00000100:00100000:1.0:1789762846.020874:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148652597653 time 148452597653 state 0x1 ref 1 00000100:00100000:0.0:1789762846.215494:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148652597653 time 148652730173 state 0x0 ref 1 00000100:00100000:0.0:1789762846.215526:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246529792:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762846.215567:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.215584:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762846.215588:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762846.215595:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.215610:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.218841:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.218864:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.218876:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.218885:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762846.218891:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.218927:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.218948:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.218955:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b59c97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762846.219032:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246529792:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3517us (198237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762846.219044:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:3.0:1789762846.219053:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148652597653 time 148652730173 state 0x2 ref 0 00000100:00100000:3.0:1789762846.220879:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762846.220928:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246529920 00000100:00100000:2.0:1789762846.220941:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246529920 00000100:00100000:2.0:1789762846.220993:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148652597653 time 148652730173 state 0x0 ref 1 00000100:00100000:2.0:1789762846.221005:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148852730173 time 148652730173 state 0x1 ref 1 00000100:00100000:1.0:1789762846.415600:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148852730173 time 148852838604 state 0x0 ref 1 00000100:00100000:1.0:1789762846.415635:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529920:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762846.415673:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.415704:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762846.415707:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762846.415712:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.415723:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.418948:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.418958:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.418965:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.418969:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762846.418981:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.418988:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.419000:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.419016:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59c9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762846.419067:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246529920:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3451us (198189us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762846.419073:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:1.0:1789762846.419078:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148852730173 time 148852838604 state 0x2 ref 0 00000100:00100000:3.0:1789762846.420942:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762846.420982:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530048 00000100:00100000:1.0:1789762846.420990:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530048 00000100:00100000:1.0:1789762846.421023:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 148852730173 time 148852838604 state 0x0 ref 1 00000100:00100000:1.0:1789762846.421032:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149052838604 time 148852838604 state 0x1 ref 1 00010000:00010000:0.0:1789762846.586925:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762846.615916:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149052838604 time 149053146189 state 0x0 ref 1 00000100:00100000:3.0:1789762846.615958:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246530048:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762846.616017:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.616040:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762846.616045:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762846.616054:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762846.616085:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.619574:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.619597:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.619609:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.619616:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da3a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762846.619621:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.619648:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.619665:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762846.619671:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068292b4f/0x5915dfb1c1b59ca5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762846.619801:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246530048:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3814us (198818us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762846.619812:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:1.0:1789762846.619823:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149052838604 time 149053146189 state 0x2 ref 0 00000100:00100000:0.0:1789762846.622067:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762846.622111:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530176 00000100:00100000:3.0:1789762846.622120:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530176 00000100:00100000:3.0:1789762846.622155:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149052838604 time 149053146189 state 0x0 ref 1 00000100:00100000:3.0:1789762846.622164:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149253146189 time 149053146189 state 0x1 ref 1 00000100:00100000:0.0:1789762846.816024:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149253146189 time 149253262029 state 0x0 ref 1 00000100:00100000:0.0:1789762846.816052:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246530176:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762846.816090:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.816104:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762846.816107:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762846.816126:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.816138:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.818919:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.818930:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.818937:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.818941:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762846.818945:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.818951:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.818963:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762846.818968:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762846.819026:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246530176:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2987us (196960us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762846.819033:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:0.0:1789762846.819039:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149253146189 time 149253262029 state 0x2 ref 0 00000100:00100000:0.0:1789762846.821199:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762846.821278:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530304 00000100:00100000:1.0:1789762846.821286:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530304 00000100:00100000:1.0:1789762846.821335:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149253146189 time 149253262029 state 0x0 ref 1 00000100:00100000:1.0:1789762846.821344:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149453262029 time 149253262029 state 0x1 ref 1 00000100:00100000:0.0:1789762847.016106:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149453262029 time 149453344279 state 0x0 ref 1 00000100:00100000:0.0:1789762847.016135:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246530304:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762847.016172:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.016186:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762847.016189:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762847.016194:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.016205:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.019049:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.019060:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.019067:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.019088:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762847.019093:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.019104:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.019123:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.019130:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b59cb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.019181:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246530304:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3059us (197982us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762847.019188:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:1.0:1789762847.019193:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149453262029 time 149453344279 state 0x2 ref 0 00000100:00100000:3.0:1789762847.021422:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762847.021468:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530432 00000100:00100000:1.0:1789762847.021476:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530432 00000100:00100000:1.0:1789762847.021504:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149453262029 time 149453344279 state 0x0 ref 1 00000100:00100000:1.0:1789762847.021512:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149653344279 time 149453344279 state 0x1 ref 1 00000100:00100000:2.0:1789762847.216239:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149653344279 time 149653470151 state 0x0 ref 1 00000100:00100000:2.0:1789762847.216282:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246530432:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762847.216352:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.216398:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.216403:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762847.216412:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762847.216430:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.219897:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.219913:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.219938:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.219943:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762847.219947:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.219953:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.219969:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.219975:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb3946de/0x5915dfb1c1b59cba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762847.220048:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246530432:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3785us (198623us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762847.220057:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:0.0:1789762847.220064:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149653344279 time 149653470151 state 0x2 ref 0 00000100:00100000:3.0:1789762847.222353:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762847.222398:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530560 00000100:00100000:0.0:1789762847.222407:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530560 00000100:00100000:0.0:1789762847.222444:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149653344279 time 149653470151 state 0x0 ref 1 00000100:00100000:0.0:1789762847.222454:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149853470151 time 149653470151 state 0x1 ref 1 00000100:00100000:0.0:1789762847.416305:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149853470151 time 149853532391 state 0x0 ref 1 00000100:00100000:0.0:1789762847.416333:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246530560:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762847.416373:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.416387:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762847.416391:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762847.416396:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.416406:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.419537:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.419548:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.419555:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.419560:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762847.419564:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.419584:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.419597:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762847.419602:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762847.419654:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246530560:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3334us (197302us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762847.419662:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:0.0:1789762847.419667:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149853470151 time 149853532391 state 0x2 ref 0 00000100:00100000:3.0:1789762847.421583:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762847.421630:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530688 00000100:00100000:1.0:1789762847.421638:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530688 00000100:00100000:1.0:1789762847.421668:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 149853470151 time 149853532391 state 0x0 ref 1 00000100:00100000:1.0:1789762847.421683:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150053532391 time 149853532391 state 0x1 ref 1 00010000:00010000:3.0:1789762847.610984:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762847.616373:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150053532391 time 150053614424 state 0x0 ref 1 00000100:00100000:3.0:1789762847.616400:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246530688:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762847.616435:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.616449:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762847.616452:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762847.616457:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.616467:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.620156:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.620166:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.620173:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.620178:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762847.620181:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.620187:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.620199:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762847.620204:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762847.620249:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246530688:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3863us (198667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762847.620256:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:3.0:1789762847.620269:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150053532391 time 150053614424 state 0x2 ref 0 00000100:00100000:3.0:1789762847.621872:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762847.621915:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530816 00000100:00100000:0.0:1789762847.621924:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530816 00000100:00100000:0.0:1789762847.621956:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150053532391 time 150053614424 state 0x0 ref 1 00000100:00100000:0.0:1789762847.621964:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150253614424 time 150053614424 state 0x1 ref 1 00000100:00100000:1.0:1789762847.816459:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150253614424 time 150253695769 state 0x0 ref 1 00000100:00100000:1.0:1789762847.816491:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246530816:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762847.816532:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.816551:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.816556:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762847.816563:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.816578:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.820048:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.820058:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.820065:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.820070:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762847.820073:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.820093:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.820106:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762847.820111:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ccf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762847.820167:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246530816:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3690us (198295us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762847.820173:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:1.0:1789762847.820178:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150253614424 time 150253695769 state 0x2 ref 0 00000100:00100000:3.0:1789762847.821925:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762847.822001:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246530944 00000100:00100000:0.0:1789762847.822010:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246530944 00000100:00100000:0.0:1789762847.822042:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150253614424 time 150253695769 state 0x0 ref 1 00000100:00100000:0.0:1789762847.822050:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150453695769 time 150253695769 state 0x1 ref 1 00000100:00100000:3.0:1789762848.016539:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150453695769 time 150453776634 state 0x0 ref 1 00000100:00100000:3.0:1789762848.016588:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246530944:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:0.0:1789762848.016600:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762848.016632:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.016648:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.016651:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762848.016656:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762848.016667:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.020023:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.020033:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.020039:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.020045:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762848.020048:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.020061:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.020079:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.020089:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6962680/0x5915dfb1c1b59cd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762848.020141:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246530944:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3587us (198216us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762848.020148:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:1.0:1789762848.020154:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150453695769 time 150453776634 state 0x2 ref 0 00000100:00100000:2.0:1789762848.021952:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762848.021994:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531072 00000100:00100000:3.0:1789762848.022002:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531072 00000100:00100000:3.0:1789762848.022032:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150453695769 time 150453776634 state 0x0 ref 1 00000100:00100000:3.0:1789762848.022040:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150653776634 time 150453776634 state 0x1 ref 1 00000100:00100000:2.0:1789762848.216632:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150653776634 time 150653870186 state 0x0 ref 1 00000100:00100000:2.0:1789762848.216659:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246531072:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762848.216695:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762848.216709:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762848.216713:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762848.216719:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762848.216734:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.220264:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.220302:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.220309:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.220314:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d38800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762848.220318:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.220327:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.220346:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.220356:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6039259/0x5915dfb1c1b59cdd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762848.220426:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246531072:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3776us (198471us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762848.220435:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:0.0:1789762848.220441:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150653776634 time 150653870186 state 0x2 ref 0 00000100:00100000:2.0:1789762848.222591:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762848.222637:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531200 00000100:00100000:1.0:1789762848.222645:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531200 00000100:00100000:1.0:1789762848.222681:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150653776634 time 150653870186 state 0x0 ref 1 00000100:00100000:1.0:1789762848.222690:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150853870186 time 150653870186 state 0x1 ref 1 00000100:00100000:1.0:1789762848.416694:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150853870186 time 150853930644 state 0x0 ref 1 00000100:00100000:1.0:1789762848.416726:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246531200:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762848.416778:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.416809:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.416813:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762848.416821:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.416836:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.420170:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.420180:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.420188:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.420196:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762848.420201:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.420211:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.420228:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762848.420251:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59ce4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762848.420314:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246531200:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3601us (197726us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762848.420322:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:1.0:1789762848.420327:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150853870186 time 150853930644 state 0x2 ref 0 00000100:00100000:3.0:1789762848.422430:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762848.422476:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531328 00000100:00100000:1.0:1789762848.422485:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531328 00000100:00100000:1.0:1789762848.422516:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 150853870186 time 150853930644 state 0x0 ref 1 00000100:00100000:1.0:1789762848.422524:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151053930644 time 150853930644 state 0x1 ref 1 00000100:00100000:1.0:1789762848.570880:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789762848.570907:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254905216:0@lo:400:kworker.0 00000100:00100000:2.0:1789762848.570908:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254904960:0@lo:400:kworker.0 00000100:00100000:3.0:1789762848.570953:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254905344:0@lo:400:kworker.0 00000100:00100000:0.0:1789762848.570979:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254905600:0@lo:400:kworker.0 00000100:00100000:2.0:1789762848.570995:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762848.571003:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762848.571037:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762848.571039:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254904960 00000100:00100000:3.0:1789762848.571047:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254904960 00000100:00100000:0.0:1789762848.571069:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762848.571076:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254905088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762848.571076:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254905472:0@lo:400:kworker.0 00000100:00100000:0.0:1789762848.571079:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254905728:0@lo:400:kworker.0 00000100:00100000:3.0:1789762848.571101:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789762848.571110:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254904960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762848.571126:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762848.571132:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762848.571159:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905216 00000100:00100000:2.0:1789762848.571164:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905216 00000100:00100000:1.0:1789762848.571178:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905088 00000100:00100000:3.0:1789762848.571180:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254904960:12345-0@lo:400:kworker.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762848.571185:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905088 00000100:00100000:3.0:1789762848.571189:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789762848.571197:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905600 00000100:00100000:0.0:1789762848.571203:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905600 00000100:00100000:2.0:1789762848.571204:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789762848.571219:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254905216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762848.571243:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789762848.571251:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789762848.571256:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254905600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762848.571267:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905728 00000100:00100000:1.0:1789762848.571267:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254905088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762848.571272:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905728 00000100:00100000:2.0:1789762848.571290:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254905216:12345-0@lo:400:kworker.0 Request processed in 64us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762848.571298:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00002000:00000024:1.0:1789762848.571313:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762848.571318:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254905600:12345-0@lo:400:kworker.0 Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762848.571326:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762848.571332:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789762848.571337:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762848.571347:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254905728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762848.571348:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905344 00000100:00100000:3.0:1789762848.571355:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905344 00000100:00100000:1.0:1789762848.571369:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254905088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762848.571392:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789762848.571398:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789762848.571399:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254905728:12345-0@lo:400:kworker.0 Request processed in 53us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762848.571408:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789762848.571412:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254905344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762848.571422:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762848.571437:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905472 00000100:00100000:0.0:1789762848.571442:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905472 00000100:00100000:2.0:1789762848.571468:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254904960:0@lo:400:kworker.0 00000100:00100000:1.0:1789762848.571475:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254905216:0@lo:400:kworker.0 00000100:00100000:3.0:1789762848.571475:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254905344:12345-0@lo:400:kworker.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762848.571480:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789762848.571492:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789762848.571496:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254905472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762848.571507:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254905088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762848.571528:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254905344:0@lo:400:kworker.0 00000100:00080000:3.0:1789762848.571540:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762848.571542:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254905472:12345-0@lo:400:kworker.0 Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762848.571546:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762848.571551:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789762848.571552:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762848.571565:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254905472:0@lo:400:kworker.0 00000100:00100000:1.0:1789762848.571579:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254905728:0@lo:400:kworker.0 00000100:00100000:1.0:1789762848.571591:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254905600:0@lo:400:kworker.0 00000100:00100000:0.0:1789762848.616794:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151053930644 time 151054033089 state 0x0 ref 1 00000100:00100000:0.0:1789762848.616819:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246531328:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762848.616853:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.616867:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762848.616882:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762848.616887:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.616904:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.620622:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.620632:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.620638:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.620643:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762848.620646:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.620652:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.620664:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.620676:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59ceb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762848.620733:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246531328:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3924us (198304us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762848.620740:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:0.0:1789762848.620745:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151053930644 time 151054033089 state 0x2 ref 0 00000100:00100000:2.0:1789762848.622802:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762848.622833:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531456 00000100:00100000:0.0:1789762848.622841:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531456 00000100:00100000:0.0:1789762848.622869:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151053930644 time 151054033089 state 0x0 ref 1 00000100:00100000:0.0:1789762848.622878:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151254033089 time 151054033089 state 0x1 ref 1 00010000:00010000:0.0:1789762848.634862:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762848.816854:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151254033089 time 151254090926 state 0x0 ref 1 00000100:00100000:0.0:1789762848.816882:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246531456:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762848.816926:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.816940:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762848.816944:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762848.816949:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.816959:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.820164:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.820187:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.820194:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.820199:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762848.820202:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.820209:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.820222:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762848.820227:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59cf2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762848.820294:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246531456:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3423us (197490us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762848.820303:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:0.0:1789762848.820308:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151254033089 time 151254090926 state 0x2 ref 0 00000100:00100000:1.0:1789762848.822163:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762848.822199:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531584 00000100:00100000:0.0:1789762848.822213:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531584 00000100:00100000:0.0:1789762848.822242:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151254033089 time 151254090926 state 0x0 ref 1 00000100:00100000:0.0:1789762848.822250:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151454090926 time 151254090926 state 0x1 ref 1 00000100:00100000:3.0:1789762849.016965:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151454090926 time 151454202498 state 0x0 ref 1 00000100:00100000:3.0:1789762849.016994:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246531584:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762849.017031:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.017045:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762849.017061:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762849.017067:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.017078:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.020928:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.020939:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.020945:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.020950:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d3b400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762849.020954:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.020960:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.020972:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.020976:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b741f9e/0x5915dfb1c1b59cf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762849.021031:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246531584:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4050us (198870us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762849.021038:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:3.0:1789762849.021044:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151454090926 time 151454202498 state 0x2 ref 0 00000100:00100000:3.0:1789762849.023010:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762849.023067:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531712 00000100:00100000:0.0:1789762849.023076:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531712 00000100:00100000:0.0:1789762849.023109:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151454090926 time 151454202498 state 0x0 ref 1 00000100:00100000:0.0:1789762849.023117:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151654202498 time 151454202498 state 0x1 ref 1 00000100:00100000:1.0:1789762849.155845:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762849.155882:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762849.155890:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531968 00000100:00100000:0.0:1789762849.155900:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531968 00000100:00100000:1.0:1789762849.155908:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762849.155934:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246531840 00000100:00080000:1.0:1789762849.155942:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762849.155942:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246531840 00000100:00100000:2.0:1789762849.155969:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532096 00000100:00100000:0.0:1789762849.155975:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:2.0:1789762849.155977:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532096 00000100:00100000:0.0:1789762849.155985:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246531968:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762849.156003:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:3.0:1789762849.156018:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246531840:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762849.156026:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:2.0:1789762849.156037:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246532096:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762849.156062:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246531968:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762849.156071:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246531840:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 54us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762849.156076:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:2.0:1789762849.156084:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246532096:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 48us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762849.156090:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:2.0:1789762849.156096:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00080000:2.0:1789762849.156131:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762849.217062:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151654202498 time 151654300503 state 0x0 ref 1 00000100:00100000:1.0:1789762849.217087:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246531712:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762849.217123:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.217137:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.217141:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.217145:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.217156:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.220426:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.220447:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.220454:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.220459:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762849.220462:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.220469:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.220483:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.220488:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762849.220537:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246531712:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3461us (197526us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762849.220544:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:2.0:1789762849.220550:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151654202498 time 151654300503 state 0x2 ref 0 00000100:00100000:3.0:1789762849.222597:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762849.222644:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532224 00000100:00100000:0.0:1789762849.222652:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532224 00000100:00100000:0.0:1789762849.222690:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151654202498 time 151654300503 state 0x0 ref 1 00000100:00100000:0.0:1789762849.222702:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151854300503 time 151654300503 state 0x1 ref 1 00000100:00100000:1.0:1789762849.417162:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151854300503 time 151854399973 state 0x0 ref 1 00000100:00100000:1.0:1789762849.417194:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246532224:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762849.417240:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.417257:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.417260:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.417265:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.417292:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.420809:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.420820:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.420826:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.420830:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762849.420834:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.420847:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.420861:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762849.420866:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b59d07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762849.420911:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246532224:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3732us (198314us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762849.420917:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:3.0:1789762849.420922:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151854300503 time 151854399973 state 0x2 ref 0 00000100:00100000:3.0:1789762849.422959:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762849.423003:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532352 00000100:00100000:0.0:1789762849.423012:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532352 00000100:00100000:0.0:1789762849.423044:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 151854300503 time 151854399973 state 0x0 ref 1 00000100:00100000:0.0:1789762849.423053:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152054399973 time 151854399973 state 0x1 ref 1 00000100:00100000:2.0:1789762849.617247:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152054399973 time 152054485583 state 0x0 ref 1 00000100:00100000:2.0:1789762849.617301:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246532352:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762849.617339:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.617354:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762849.617358:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762849.617363:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.617375:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.621910:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.621926:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.621932:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.621937:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da5000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762849.621941:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.621947:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.621967:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762849.621972:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762849.622018:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246532352:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4727us (199061us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762849.622024:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:2.0:1789762849.622029:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152054399973 time 152054485583 state 0x2 ref 0 00000100:00100000:2.0:1789762849.624050:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762849.624097:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532480 00000100:00100000:1.0:1789762849.624105:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532480 00000100:00100000:1.0:1789762849.624138:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152054399973 time 152054485583 state 0x0 ref 1 00000100:00100000:1.0:1789762849.624147:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152254485583 time 152054485583 state 0x1 ref 1 00010000:00010000:1.0:1789762849.658880:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762849.817328:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152254485583 time 152254564844 state 0x0 ref 1 00000100:00100000:1.0:1789762849.817364:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246532480:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762849.817409:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.817443:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.817447:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762849.817452:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762849.817464:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762849.823729:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762849.823776:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762849.823784:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762849.823789:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75e2e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762849.823792:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762849.823799:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762849.823814:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762849.823819:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075b87727/0x5915dfb1c1b59d15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762849.823875:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246532480:12345-192.168.203.36@tcp:3:dd.500 Request processed in 6525us (199822us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762849.823886:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:0.0:1789762849.823894:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152254485583 time 152254564844 state 0x2 ref 0 00000100:00100000:2.0:1789762849.825877:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762849.825916:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532608 00000100:00100000:3.0:1789762849.825924:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532608 00000100:00100000:3.0:1789762849.825957:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152254485583 time 152254564844 state 0x0 ref 1 00000100:00100000:3.0:1789762849.825966:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152454564844 time 152254564844 state 0x1 ref 1 00000100:00100000:2.0:1789762850.017426:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152454564844 time 152454664118 state 0x0 ref 1 00000100:00100000:2.0:1789762850.017463:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246532608:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:1.0:1789762850.017485:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762850.017499:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.017513:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762850.017516:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762850.017521:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.017532:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.024425:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.024445:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.024452:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.024457:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da5000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762850.024461:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.024467:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.024481:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.024486:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb01ac56/0x5915dfb1c1b59d1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762850.024535:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246532608:12345-192.168.203.36@tcp:3:dd.500 Request processed in 7093us (198657us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762850.024544:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 184 00000100:00100000:0.0:1789762850.024550:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152454564844 time 152454664118 state 0x2 ref 0 00000100:00100000:3.0:1789762850.026443:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762850.026485:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532736 00000100:00100000:2.0:1789762850.026493:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532736 00000100:00100000:2.0:1789762850.026525:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152454564844 time 152454664118 state 0x0 ref 1 00000100:00100000:2.0:1789762850.026534:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152654664118 time 152454664118 state 0x1 ref 1 00000100:00100000:0.0:1789762850.217524:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152654664118 time 152654761364 state 0x0 ref 1 00000100:00100000:0.0:1789762850.217574:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246532736:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762850.217618:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.217634:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762850.217639:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762850.217645:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.217661:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.221067:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.221081:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.221091:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.221099:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762850.221104:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.221113:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.221135:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.221141:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762850.221187:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246532736:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3627us (194744us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762850.221195:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:0.0:1789762850.221200:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152654664118 time 152654761364 state 0x2 ref 0 00000100:00100000:3.0:1789762850.223060:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762850.223108:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532864 00000100:00100000:0.0:1789762850.223115:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532864 00000100:00100000:0.0:1789762850.223145:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152654664118 time 152654761364 state 0x0 ref 1 00000100:00100000:0.0:1789762850.223154:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152854761364 time 152654761364 state 0x1 ref 1 00000100:00100000:0.0:1789762850.417605:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152854761364 time 152854840886 state 0x0 ref 1 00000100:00100000:0.0:1789762850.417639:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246532864:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762850.417687:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.417706:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762850.417711:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762850.417717:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.417747:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.421017:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.421032:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.421042:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.421051:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762850.421056:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.421067:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.421085:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762850.421094:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762850.421165:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246532864:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3542us (198103us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762850.421175:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 186 00000100:00100000:0.0:1789762850.421182:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152854761364 time 152854840886 state 0x2 ref 0 00000100:00100000:2.0:1789762850.423012:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762850.423052:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246532992 00000100:00100000:0.0:1789762850.423059:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246532992 00000100:00100000:0.0:1789762850.423089:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 152854761364 time 152854840886 state 0x0 ref 1 00000100:00100000:0.0:1789762850.423097:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153054840886 time 152854840886 state 0x1 ref 1 00000100:00100000:1.0:1789762850.617701:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153054840886 time 153054938251 state 0x0 ref 1 00000100:00100000:1.0:1789762850.617734:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246532992:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762850.617798:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.617813:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762850.617817:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762850.617821:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762850.617833:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762850.618904:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254905856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762850.618956:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762850.619014:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905856 00000100:00100000:1.0:1789762850.619021:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905856 00000100:00080000:2.0:1789762850.619056:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762850.619077:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789762850.619104:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254905856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762850.619124:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:1.0:1789762850.619167:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254905856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762850.619174:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789762850.619209:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254905856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762850.621451:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.621462:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.621468:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.621473:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec91e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762850.621477:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.621483:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.621508:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762850.621514:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc3647f6/0x5915dfb1c1b59d31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762850.621552:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246532992:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3834us (198541us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762850.621559:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:2.0:1789762850.621564:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153054840886 time 153054938251 state 0x2 ref 0 00000100:00100000:2.0:1789762850.623457:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762850.623501:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246533120 00000100:00100000:0.0:1789762850.623507:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246533120 00000100:00100000:0.0:1789762850.623534:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153054840886 time 153054938251 state 0x0 ref 1 00000100:00100000:0.0:1789762850.623542:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153254938251 time 153054938251 state 0x1 ref 1 00010000:00010000:0.0:1789762850.682932:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762850.817806:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153254938251 time 153255044603 state 0x0 ref 1 00000100:00100000:3.0:1789762850.817834:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246533120:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762850.817886:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.817908:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.817912:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762850.817916:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.817927:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.821388:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.821399:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.821406:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.821411:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762850.821414:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.821421:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.821443:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762850.821449:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b59d38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762850.821494:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246533120:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3673us (198037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762850.821501:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:3.0:1789762850.821506:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153254938251 time 153255044603 state 0x2 ref 0 00000100:00100000:3.0:1789762850.823446:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762850.823493:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246533248 00000100:00100000:0.0:1789762850.823501:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246533248 00000100:00100000:0.0:1789762850.823534:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153254938251 time 153255044603 state 0x0 ref 1 00000100:00100000:0.0:1789762850.823544:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153455044603 time 153255044603 state 0x1 ref 1 00000100:00100000:2.0:1789762851.017882:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153455044603 time 153455120473 state 0x0 ref 1 00000100:00100000:2.0:1789762851.017909:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246533248:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762851.017944:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.017958:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.017962:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.017966:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.017977:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.021365:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.021380:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.021389:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.021395:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762851.021398:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.021405:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.021418:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.021423:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762851.021473:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246533248:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3575us (198026us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762851.021480:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:2.0:1789762851.021492:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153455044603 time 153455120473 state 0x2 ref 0 00000100:00100000:1.0:1789762851.023475:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762851.023520:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246533376 00000100:00100000:2.0:1789762851.023529:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246533376 00000100:00100000:2.0:1789762851.023560:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153455044603 time 153455120473 state 0x0 ref 1 00000100:00100000:2.0:1789762851.023569:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153655120473 time 153455120473 state 0x1 ref 1 00000100:00100000:1.0:1789762851.217968:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153655120473 time 153655206148 state 0x0 ref 1 00000100:00100000:1.0:1789762851.217996:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246533376:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762851.218032:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.218047:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.218050:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762851.218055:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.218065:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.221694:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.221707:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.221727:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.221748:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2f600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762851.221776:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.221787:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.221806:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762851.221814:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8055f56/0x5915dfb1c1b59d46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762851.221864:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246533376:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3881us (198390us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762851.221872:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:1.0:1789762851.221878:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153655120473 time 153655206148 state 0x2 ref 0 00000100:00100000:1.0:1789762851.223989:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762851.224029:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246533504 00000100:00100000:3.0:1789762851.224038:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246533504 00000100:00100000:3.0:1789762851.224069:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153655120473 time 153655206148 state 0x0 ref 1 00000100:00100000:3.0:1789762851.224078:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153855206148 time 153655206148 state 0x1 ref 1 00000100:00100000:2.0:1789762851.418083:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153855206148 time 153855320053 state 0x0 ref 1 00000100:00100000:2.0:1789762851.418115:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246533504:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762851.418156:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.418172:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.418176:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762851.418183:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.418197:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.421288:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.421300:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.421307:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.421324:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762851.421328:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.421334:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.421347:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762851.421352:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762851.421397:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246533504:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3296us (197406us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762851.421405:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1789762851.421411:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153855206148 time 153855320053 state 0x2 ref 0 00000100:00100000:1.0:1789762851.423419:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762851.423455:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246533632 00000100:00100000:2.0:1789762851.423462:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246533632 00000100:00100000:2.0:1789762851.423491:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 153855206148 time 153855320053 state 0x0 ref 1 00000100:00100000:2.0:1789762851.423499:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154055320053 time 153855320053 state 0x1 ref 1 00000100:00100000:0.0:1789762851.618206:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154055320053 time 154055443768 state 0x0 ref 1 00000100:00100000:0.0:1789762851.618236:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246533632:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762851.618290:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.618330:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762851.618334:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762851.618341:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.618358:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.621741:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.621776:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.621785:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.621794:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762851.621799:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.621809:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.621828:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.621850:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762851.621912:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246533632:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3686us (198491us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762851.621923:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:0.0:1789762851.621930:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154055320053 time 154055443768 state 0x2 ref 0 00000100:00100000:3.0:1789762851.623792:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762851.623833:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246533760 00000100:00100000:1.0:1789762851.623841:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246533760 00000100:00100000:1.0:1789762851.623874:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154055320053 time 154055443768 state 0x0 ref 1 00000100:00100000:1.0:1789762851.623882:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154255443768 time 154055443768 state 0x1 ref 1 00010000:00010000:3.0:1789762851.706895:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762851.818295:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154255443768 time 154255533383 state 0x0 ref 1 00000100:00100000:0.0:1789762851.818324:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246533760:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762851.818360:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.818374:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762851.818378:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762851.818383:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762851.818393:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762851.822055:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762851.822067:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762851.822074:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762851.822087:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762851.822091:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762851.822097:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762851.822110:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762851.822115:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b59d5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762851.822164:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246533760:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3852us (198371us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762851.822171:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:3.0:1789762851.822177:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154255443768 time 154255533383 state 0x2 ref 0 00000100:00100000:3.0:1789762851.824335:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762851.824408:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246533888 00000100:00100000:2.0:1789762851.824418:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246533888 00000100:00100000:2.0:1789762851.824457:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154255443768 time 154255533383 state 0x0 ref 1 00000100:00100000:2.0:1789762851.824475:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154455533383 time 154255533383 state 0x1 ref 1 00000100:00100000:1.0:1789762852.018389:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154455533383 time 154455626876 state 0x0 ref 1 00000100:00100000:1.0:1789762852.018442:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246533888:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:2.0:1789762852.018460:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762852.018481:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.018495:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.018498:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.018503:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.018513:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.021938:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.021955:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.021966:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.021975:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d97e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762852.021979:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.021987:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.022002:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.022007:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009238feb4/0x5915dfb1c1b59d62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762852.022068:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246533888:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3646us (197731us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762852.022087:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:2.0:1789762852.022093:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154455533383 time 154455626876 state 0x2 ref 0 00000100:00100000:1.0:1789762852.024233:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762852.024292:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534016 00000100:00100000:0.0:1789762852.024300:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534016 00000100:00100000:0.0:1789762852.024333:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154455533383 time 154455626876 state 0x0 ref 1 00000100:00100000:0.0:1789762852.024351:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154655626876 time 154455626876 state 0x1 ref 1 00000100:00100000:3.0:1789762852.218513:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154655626876 time 154655748461 state 0x0 ref 1 00000100:00100000:3.0:1789762852.218548:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534016:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762852.218593:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.218630:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762852.218635:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762852.218642:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.218657:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.222122:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.222135:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.222142:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.222147:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da2000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762852.222150:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.222157:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.222171:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762852.222195:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038fa029a/0x5915dfb1c1b59d69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762852.222268:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534016:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3721us (198019us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762852.222280:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:3.0:1789762852.222288:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154655626876 time 154655748461 state 0x2 ref 0 00000100:00100000:0.0:1789762852.224277:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762852.224316:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534144 00000100:00100000:3.0:1789762852.224324:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534144 00000100:00100000:3.0:1789762852.224357:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154655626876 time 154655748461 state 0x0 ref 1 00000100:00100000:3.0:1789762852.224366:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154855748461 time 154655748461 state 0x1 ref 1 00000100:00100000:0.0:1789762852.418589:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154855748461 time 154855826456 state 0x0 ref 1 00000100:00100000:0.0:1789762852.418621:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534144:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762852.418664:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.418683:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762852.418689:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762852.418695:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.418708:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.421824:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.421834:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.421839:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.421844:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2e000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762852.421854:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.421862:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.421877:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762852.421883:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef4e5a03/0x5915dfb1c1b59d70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762852.421932:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534144:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3325us (197656us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762852.421939:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:0.0:1789762852.421943:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154855748461 time 154855826456 state 0x2 ref 0 00000100:00100000:0.0:1789762852.423744:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762852.423790:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534272 00000100:00100000:2.0:1789762852.423797:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534272 00000100:00100000:2.0:1789762852.423835:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 154855748461 time 154855826456 state 0x0 ref 1 00000100:00100000:2.0:1789762852.423844:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155055826456 time 154855826456 state 0x1 ref 1 00000100:00100000:1.0:1789762852.618678:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155055826456 time 155055913943 state 0x0 ref 1 00000100:00100000:1.0:1789762852.618710:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246534272:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762852.618777:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.618794:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762852.618797:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762852.618802:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.618815:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.622339:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.622353:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.622368:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.622376:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762852.622381:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.622390:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.622410:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762852.622419:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b59d77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762852.622473:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246534272:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3774us (198726us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762852.622481:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:1.0:1789762852.622495:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155055826456 time 155055913943 state 0x2 ref 0 00000100:00100000:1.0:1789762852.624696:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762852.624728:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534400 00000100:00100000:3.0:1789762852.624736:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534400 00000100:00100000:3.0:1789762852.624788:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155055826456 time 155055913943 state 0x0 ref 1 00000100:00100000:3.0:1789762852.624797:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155255913943 time 155055913943 state 0x1 ref 1 00010000:00010000:0.0:1789762852.730901:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762852.818797:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155255913943 time 155256034004 state 0x0 ref 1 00000100:00100000:2.0:1789762852.818826:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534400:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762852.818863:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.818877:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762852.818881:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762852.818885:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.818895:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.822266:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.822279:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.822299:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.822305:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762852.822308:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.822314:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.822327:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762852.822332:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df4dc49/0x5915dfb1c1b59d7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762852.822383:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534400:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3569us (197686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762852.822390:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:2.0:1789762852.822396:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155255913943 time 155256034004 state 0x2 ref 0 00000100:00100000:3.0:1789762852.824389:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762852.824439:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534528 00000100:00100000:0.0:1789762852.824447:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534528 00000100:00100000:0.0:1789762852.824480:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155255913943 time 155256034004 state 0x0 ref 1 00000100:00100000:0.0:1789762852.824489:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155456034004 time 155256034004 state 0x1 ref 1 00000100:00100000:0.0:1789762853.018852:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155456034004 time 155456091189 state 0x0 ref 1 00000100:00100000:0.0:1789762853.018881:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246534528:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762853.018934:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.018948:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762853.018952:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762853.018956:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.018967:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.022560:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.022573:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.022580:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.022585:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762853.022589:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.022595:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.022608:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.022612:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b59d85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762853.022667:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246534528:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3798us (198277us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762853.022678:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:1.0:1789762853.022695:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155456034004 time 155456091189 state 0x2 ref 0 00000100:00100000:3.0:1789762853.024727:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762853.024775:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534656 00000100:00100000:1.0:1789762853.024782:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534656 00000100:00100000:1.0:1789762853.024813:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155456034004 time 155456091189 state 0x0 ref 1 00000100:00100000:1.0:1789762853.024822:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155656091189 time 155456091189 state 0x1 ref 1 00000100:00100000:0.0:1789762853.218938:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155656091189 time 155656175978 state 0x0 ref 1 00000100:00100000:0.0:1789762853.218967:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246534656:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762853.219003:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.219017:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762853.219021:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762853.219025:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.219036:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.222356:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.222387:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.222394:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.222400:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762853.222404:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.222410:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.222424:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.222429:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ea7b18/0x5915dfb1c1b59d8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762853.222482:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246534656:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3528us (197754us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762853.222489:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:0.0:1789762853.222495:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155656091189 time 155656175978 state 0x2 ref 0 00000100:00100000:2.0:1789762853.224473:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762853.224511:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534784 00000100:00100000:0.0:1789762853.224525:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534784 00000100:00100000:0.0:1789762853.224557:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155656091189 time 155656175978 state 0x0 ref 1 00000100:00100000:0.0:1789762853.224566:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155856175978 time 155656175978 state 0x1 ref 1 00000100:00100000:2.0:1789762853.419028:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155856175978 time 155856266868 state 0x0 ref 1 00000100:00100000:2.0:1789762853.419055:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534784:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762853.419107:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.419122:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.419125:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.419130:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.419141:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.422716:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.422728:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.422735:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.422740:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f4642800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762853.422743:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.422766:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.422779:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762853.422785:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd146e/0x5915dfb1c1b59d93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762853.422845:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246534784:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3801us (198372us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762853.422853:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:1.0:1789762853.422858:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155856175978 time 155856266868 state 0x2 ref 0 00000100:00100000:3.0:1789762853.424777:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762853.424809:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246534912 00000100:00100000:1.0:1789762853.424818:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246534912 00000100:00100000:1.0:1789762853.424850:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 155856175978 time 155856266868 state 0x0 ref 1 00000100:00100000:1.0:1789762853.424859:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156056266868 time 155856266868 state 0x1 ref 1 00000100:00100000:3.0:1789762853.619098:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156056266868 time 156056336481 state 0x0 ref 1 00000100:00100000:3.0:1789762853.619127:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246534912:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762853.619164:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.619191:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762853.619194:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762853.619199:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.619212:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.622411:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.622423:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.622431:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.622436:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762853.622440:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.622446:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.622458:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762853.622474:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b78a7a/0x5915dfb1c1b59d9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762853.622521:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246534912:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3408us (197745us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762853.622528:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:3.0:1789762853.622534:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156056266868 time 156056336481 state 0x2 ref 0 00000100:00100000:3.0:1789762853.624416:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762853.624457:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535040 00000100:00100000:0.0:1789762853.624466:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535040 00000100:00100000:0.0:1789762853.624499:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156056266868 time 156056336481 state 0x0 ref 1 00000100:00100000:0.0:1789762853.624508:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156256336481 time 156056336481 state 0x1 ref 1 00000100:00100000:1.0:1789762853.690917:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254905984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762853.690944:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254906112:0@lo:400:kworker.0 00000100:00100000:0.0:1789762853.690948:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254906240:0@lo:400:kworker.0 00000100:00100000:3.0:1789762853.690968:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254906368:0@lo:400:kworker.0 00000100:00100000:1.0:1789762853.691005:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762853.691008:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762853.691013:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762853.691047:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254906112 00000100:00100000:3.0:1789762853.691054:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254906112 00000100:00100000:2.0:1789762853.691077:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254906496:0@lo:400:kworker.0 00000100:00100000:0.0:1789762853.691079:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254906752:0@lo:400:kworker.0 00000100:00100000:1.0:1789762853.691081:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254906624:0@lo:400:kworker.0 00000100:00100000:3.0:1789762853.691100:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789762853.691110:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254906112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762853.691120:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762853.691133:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762853.691150:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254906240 00000100:00100000:0.0:1789762853.691155:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254906240 00000100:00100000:3.0:1789762853.691179:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254906112:12345-0@lo:400:kworker.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762853.691182:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254906112:0@lo:400:kworker.0 00000100:00100000:3.0:1789762853.691193:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789762853.691197:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254905984 00000100:00100000:0.0:1789762853.691200:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254906624 00000100:00100000:1.0:1789762853.691202:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254905984 00000100:00100000:0.0:1789762853.691205:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254906624 00000100:00100000:2.0:1789762853.691223:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254906496 00000100:00100000:2.0:1789762853.691228:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254906496 00000100:00100000:3.0:1789762853.691273:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789762853.691277:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789762853.691283:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789762853.691284:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254906240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762853.691294:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254905984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762853.691299:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254906624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762853.691301:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789762853.691317:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254906496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762853.691323:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254906240:12345-0@lo:400:kworker.0 Request processed in 40us (316us total) trans 0 rc 0/0 00002000:00000024:1.0:1789762853.691325:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762853.691331:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789762853.691358:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762853.691364:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254906624:12345-0@lo:400:kworker.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762853.691372:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789762853.691380:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254906496:12345-0@lo:400:kworker.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762853.691388:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789762853.691395:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254906368 00000100:00100000:1.0:1789762853.691396:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254905984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762853.691401:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254906368 00000100:00100000:1.0:1789762853.691407:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789762853.691443:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789762853.691445:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254906496:0@lo:400:kworker.0 00000100:00100000:0.0:1789762853.691457:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254906368:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762853.691477:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762853.691483:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762853.691487:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762853.691489:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254906624:0@lo:400:kworker.0 00000100:00100000:2.0:1789762853.691508:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254905984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762853.691516:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254906368:12345-0@lo:400:kworker.0 Request processed in 64us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762853.691523:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762853.691540:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789762853.691552:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254906368:0@lo:400:kworker.0 00000100:00100000:2.0:1789762853.691565:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254906752 00000100:00100000:2.0:1789762853.691569:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254906752 00000100:00100000:1.0:1789762853.691583:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254906240:0@lo:400:kworker.0 00000100:00100000:2.0:1789762853.691609:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789762853.691619:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254906752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762853.691663:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254906752:12345-0@lo:400:kworker.0 Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762853.691671:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789762853.691695:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254906752:0@lo:400:kworker.0 00010000:00010000:1.0:1789762853.754895:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762853.819167:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156256336481 time 156256405394 state 0x0 ref 1 00000100:00100000:2.0:1789762853.819196:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246535040:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762853.819233:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.819261:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.819265:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762853.819269:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762853.819280:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.823091:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.823103:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.823111:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.823116:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762853.823119:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.823125:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.823138:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762853.823143:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b59da1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762853.823200:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246535040:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4017us (198783us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762853.823208:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:0.0:1789762853.823220:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156256336481 time 156256405394 state 0x2 ref 0 00000100:00100000:3.0:1789762853.825133:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762853.825183:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535168 00000100:00100000:1.0:1789762853.825192:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535168 00000100:00100000:1.0:1789762853.825225:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156256336481 time 156256405394 state 0x0 ref 1 00000100:00100000:1.0:1789762853.825234:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156456405394 time 156256405394 state 0x1 ref 1 00000100:00100000:0.0:1789762854.019261:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156456405394 time 156456498923 state 0x0 ref 1 00000100:00100000:0.0:1789762854.019303:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246535168:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:1.0:1789762854.019334:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762854.019343:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.019357:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762854.019360:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762854.019365:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.019376:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.022606:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.022622:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.022632:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.022640:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da4e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762854.022645:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.022654:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.022682:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.022697:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000591c9429/0x5915dfb1c1b59da8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762854.022795:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246535168:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3516us (197659us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762854.022806:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:1.0:1789762854.022814:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156456405394 time 156456498923 state 0x2 ref 0 00000100:00100000:3.0:1789762854.024879:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762854.024922:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535296 00000100:00100000:1.0:1789762854.024930:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535296 00000100:00100000:1.0:1789762854.024963:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156456405394 time 156456498923 state 0x0 ref 1 00000100:00100000:1.0:1789762854.024976:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156656498923 time 156456498923 state 0x1 ref 1 00000100:00100000:2.0:1789762854.219359:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156656498923 time 156656595314 state 0x0 ref 1 00000100:00100000:2.0:1789762854.219393:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246535296:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762854.219435:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.219485:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.219490:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762854.219497:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.219511:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.222724:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.222736:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.222743:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.222765:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2de00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762854.222769:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.222783:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.222797:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.222803:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82ee313/0x5915dfb1c1b59daf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762854.222852:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246535296:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3474us (197972us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762854.222860:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:0.0:1789762854.222866:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156656498923 time 156656595314 state 0x2 ref 0 00000100:00100000:3.0:1789762854.224691:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762854.224731:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535424 00000100:00100000:0.0:1789762854.224739:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535424 00000100:00100000:0.0:1789762854.224790:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156656498923 time 156656595314 state 0x0 ref 1 00000100:00100000:0.0:1789762854.224799:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156856595314 time 156656595314 state 0x1 ref 1 00000100:00100000:2.0:1789762854.275686:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762854.275716:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762854.275737:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535552 00000100:00100000:2.0:1789762854.275743:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762854.275746:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535552 00000100:00100000:0.0:1789762854.275798:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535680 00000100:00100000:1.0:1789762854.275799:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535808 00000100:00100000:0.0:1789762854.275805:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535680 00000100:00100000:1.0:1789762854.275807:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535808 00000100:00100000:3.0:1789762854.275822:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:3.0:1789762854.275834:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246535552:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:2.0:1789762854.275850:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762854.275866:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:2.0:1789762854.275880:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:0.0:1789762854.275881:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246535680:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762854.275895:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246535808:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762854.275903:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246535552:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762854.275914:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:0.0:1789762854.275924:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246535680:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762854.275936:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246535808:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762854.275949:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:0.0:1789762854.275962:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:0.0:1789762854.419417:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156856595314 time 156856655189 state 0x0 ref 1 00000100:00100000:0.0:1789762854.419443:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246535424:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762854.419481:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.419495:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762854.419499:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762854.419504:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.419514:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.423426:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.423442:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.423451:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.423458:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d73000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762854.423463:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.423486:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.423504:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.423513:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59db6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762854.423569:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246535424:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4136us (198877us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762854.423577:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:0.0:1789762854.423582:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156856595314 time 156856655189 state 0x2 ref 0 00000100:00100000:2.0:1789762854.425548:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762854.425603:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246535936 00000100:00100000:1.0:1789762854.425611:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246535936 00000100:00100000:1.0:1789762854.425658:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 156856595314 time 156856655189 state 0x0 ref 1 00000100:00100000:1.0:1789762854.425669:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157056655189 time 156856655189 state 0x1 ref 1 00000100:00100000:0.0:1789762854.619518:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157056655189 time 157056753424 state 0x0 ref 1 00000100:00100000:0.0:1789762854.619552:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246535936:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762854.619598:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.619617:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762854.619621:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762854.619629:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762854.619665:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.623031:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.623047:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.623056:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.623064:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d73000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762854.623069:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.623078:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.623111:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762854.623120:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04c1152/0x5915dfb1c1b59dbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762854.623181:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246535936:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3642us (197631us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762854.623192:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:3.0:1789762854.623200:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157056655189 time 157056753424 state 0x2 ref 0 00000100:00100000:3.0:1789762854.625086:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762854.625171:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246536064 00000100:00100000:0.0:1789762854.625181:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246536064 00000100:00100000:0.0:1789762854.625221:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157056655189 time 157056753424 state 0x0 ref 1 00000100:00100000:0.0:1789762854.625247:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157256753424 time 157056753424 state 0x1 ref 1 00010000:00010000:0.0:1789762854.778893:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762854.819610:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157256753424 time 157256848593 state 0x0 ref 1 00000100:00100000:1.0:1789762854.819641:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246536064:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762854.819680:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.819717:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.819721:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762854.819728:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762854.819741:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.823724:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.823740:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.823776:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.823792:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762854.823796:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.823803:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.823817:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762854.823823:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b59dc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762854.823875:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246536064:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4248us (198790us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762854.823882:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:2.0:1789762854.823888:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157256753424 time 157256848593 state 0x2 ref 0 00000100:00100000:3.0:1789762854.825802:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762854.825844:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246536192 00000100:00100000:0.0:1789762854.825852:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246536192 00000100:00100000:0.0:1789762854.825893:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157256753424 time 157256848593 state 0x0 ref 1 00000100:00100000:0.0:1789762854.825903:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157456848593 time 157256848593 state 0x1 ref 1 00000100:00100000:3.0:1789762855.019689:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157456848593 time 157456927623 state 0x0 ref 1 00000100:00100000:3.0:1789762855.019717:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246536192:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762855.019777:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.019792:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762855.019795:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762855.019802:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762855.019817:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.023267:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.023284:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.023292:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.023298:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da5200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762855.023301:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.023308:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.023323:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.023341:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011342df4/0x5915dfb1c1b59dcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.023393:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246536192:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3688us (197591us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.023400:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:1.0:1789762855.023406:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157456848593 time 157456927623 state 0x2 ref 0 00000100:00100000:1.0:1789762855.025341:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762855.025387:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246536320 00000100:00100000:3.0:1789762855.025396:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246536320 00000100:00100000:3.0:1789762855.025435:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157456848593 time 157456927623 state 0x0 ref 1 00000100:00100000:3.0:1789762855.025447:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157656927623 time 157456927623 state 0x1 ref 1 00000100:00100000:2.0:1789762855.219794:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157656927623 time 157657032239 state 0x0 ref 1 00000100:00100000:2.0:1789762855.219822:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246536320:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762855.219857:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.219871:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.219884:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762855.219889:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.219901:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.223414:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.223427:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.223435:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.223441:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762855.223444:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.223450:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.223464:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762855.223469:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b59dd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762855.223527:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246536320:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3717us (198185us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762855.223535:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:2.0:1789762855.223542:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157656927623 time 157657032239 state 0x2 ref 0 00000100:00100000:3.0:1789762855.225493:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762855.225530:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246536448 00000100:00100000:2.0:1789762855.225538:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246536448 00000100:00100000:2.0:1789762855.225569:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157656927623 time 157657032239 state 0x0 ref 1 00000100:00100000:2.0:1789762855.225578:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157857032239 time 157657032239 state 0x1 ref 1 00000100:00100000:1.0:1789762855.419900:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157857032239 time 157857139046 state 0x0 ref 1 00000100:00100000:1.0:1789762855.419931:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246536448:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762855.419974:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.419993:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.419998:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762855.420005:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.420021:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.423945:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.423981:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.423989:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.423994:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762855.423997:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.424004:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.424019:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.424025:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b59dd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.424094:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246536448:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4165us (198589us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.424103:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:1.0:1789762855.424110:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157857032239 time 157857139046 state 0x2 ref 0 00000100:00100000:3.0:1789762855.426119:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762855.426162:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246536576 00000100:00100000:1.0:1789762855.426179:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246536576 00000100:00100000:1.0:1789762855.426222:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 157857032239 time 157857139046 state 0x0 ref 1 00000100:00100000:1.0:1789762855.426250:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158057139046 time 157857139046 state 0x1 ref 1 00000100:00100000:0.0:1789762855.619999:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158057139046 time 158057237523 state 0x0 ref 1 00000100:00100000:0.0:1789762855.620025:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246536576:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762855.620061:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.620074:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762855.620078:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762855.620083:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.620095:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.623646:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.623662:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.623669:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.623674:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d73a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762855.623678:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.623700:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.623719:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.623728:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762855.623809:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246536576:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3793us (197690us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762855.623817:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:0.0:1789762855.623830:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158057139046 time 158057237523 state 0x2 ref 0 00000100:00100000:3.0:1789762855.626108:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762855.626151:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246536704 00000100:00100000:2.0:1789762855.626159:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246536704 00000100:00100000:2.0:1789762855.626191:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158057139046 time 158057237523 state 0x0 ref 1 00000100:00100000:2.0:1789762855.626200:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158257237523 time 158057237523 state 0x1 ref 1 00000100:00100000:0.0:1789762855.738979:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254906880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762855.739041:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762855.739101:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254906880 00000100:00100000:1.0:1789762855.739111:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254906880 00000100:00080000:2.0:1789762855.739152:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762855.739172:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789762855.739186:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254906880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762855.739218:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:1.0:1789762855.739278:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254906880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762855.739284:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789762855.739324:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254906880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762855.802904:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762855.820107:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158257237523 time 158257348489 state 0x0 ref 1 00000100:00100000:0.0:1789762855.820136:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246536704:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762855.820171:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.820185:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762855.820188:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762855.820193:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762855.820204:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.823728:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.823741:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.823748:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.823773:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d73a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762855.823780:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.823788:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.823818:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762855.823824:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a266b8b/0x5915dfb1c1b59de7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762855.823875:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246536704:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3752us (197766us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762855.823882:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:1.0:1789762855.823886:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158257237523 time 158257348489 state 0x2 ref 0 00000100:00100000:3.0:1789762855.825869:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762855.825902:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246536832 00000100:00100000:1.0:1789762855.825910:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246536832 00000100:00100000:1.0:1789762855.825942:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158257237523 time 158257348489 state 0x0 ref 1 00000100:00100000:1.0:1789762855.825951:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158457348489 time 158257348489 state 0x1 ref 1 00000100:00100000:3.0:1789762856.020234:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158457348489 time 158457461483 state 0x0 ref 1 00000100:00100000:3.0:1789762856.020277:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246536832:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:2.0:1789762856.020311:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762856.020315:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762856.020330:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762856.020334:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762856.020338:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762856.020349:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.023640:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.023658:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.023665:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.023686:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762856.023690:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.023697:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.023711:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.023716:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b59dee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762856.023805:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246536832:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3552us (197934us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762856.023814:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:0.0:1789762856.023820:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158457348489 time 158457461483 state 0x2 ref 0 00000100:00100000:2.0:1789762856.025310:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762856.025353:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246537088 00000100:00100000:3.0:1789762856.025367:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246537088 00000100:00080000:2.0:1789762856.025404:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762856.025417:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1789762856.025426:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:10448:x1876702246537088:12345-192.168.203.36@tcp:35:dd.500 00000100:00100000:3.0:1789762856.025613:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:10448:x1876702246537088:12345-192.168.203.36@tcp:35:dd.500 Request processed in 189us (304us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789762856.025619:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1789762856.050409:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762856.050478:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246537216 00000100:00100000:2.0:1789762856.050488:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246537216 00000100:00100000:2.0:1789762856.050545:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1789762856.050557:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5431:x1876702246537216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762856.050572:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762856.050607:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e2f298/0x5915dfb1c1b59b32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944576 expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.050648:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762856.050697:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:5431:x1876702246537216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762856.050707:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:1.0:1789762856.058869:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762856.058924:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246537344 00000100:00100000:2.0:1789762856.058930:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246537344 00000100:00100000:2.0:1789762856.058968:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:2.0:1789762856.058976:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:10117:x1876702246537344:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1789762856.058996:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762856.059012:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894457d expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.059070:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.059084:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.059095:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762856.059134:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1789762856.059138:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762856.059155:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.059178:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894457d expref: 13 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.059210:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894457d expref: 12 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.059219:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:2.0:1789762856.059237:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762856.059241:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461400, rc 0) 00000100:00100000:2.0:1789762856.059278:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:10117:x1876702246537344:12345-192.168.203.36@tcp:101:bash.0 Request processed in 303us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762856.059283:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:1.0:1789762856.062898:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762856.062937:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246537600 00000100:00100000:3.0:1789762856.062943:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246537600 00000100:00100000:3.0:1789762856.062972:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:3.0:1789762856.062978:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:10463:x1876702246537600:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762856.062986:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762856.062994:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944584 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762856.063039:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00010000:00010000:3.0:1789762856.063104:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59e03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944584 expref: 14 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762856.063112:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:3.0:1789762856.063114:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762856.063117:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944584 expref: 14 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762856.063124:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5c00, rc 0) 00000100:00100000:3.0:1789762856.063152:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:10463:x1876702246537600:12345-192.168.203.36@tcp:101:rm.0 Request processed in 174us (255us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789762856.063172:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1789762856.064856:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762856.064888:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246537728 00000100:00100000:3.0:1789762856.064894:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246537728 00000100:00100000:3.0:1789762856.064922:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1789762856.064928:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:10463:x1876702246537728:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:3.0:1789762856.066728:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:10463:x1876702246537728:12345-192.168.203.36@tcp:37:rm.0 Request processed in 1798us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762856.066735:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:1.0:1789762856.068144:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762856.068177:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246537984 00000100:00100000:3.0:1789762856.068181:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246537984 00000100:00100000:3.0:1789762856.068207:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:3.0:1789762856.068212:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:10463:x1876702246537984:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762856.068313:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10463:x1876702246537984:12345-192.168.203.36@tcp:35:rm.0 Request processed in 98us (168us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789762856.068321:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:1.0:1789762856.069114:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762856.069184:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246538240 00000100:00100000:2.0:1789762856.069190:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246538240 00000100:00100000:2.0:1789762856.069219:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:2.0:1789762856.069236:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10463:x1876702246538240:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:2.0:1789762856.069246:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762856.069254:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59e11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894458b expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.069291:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.069299:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.069305:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762856.069310:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1789762856.069356:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59e11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894458b expref: 17 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.069366:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894458b expref: 16 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.069372:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:2.0:1789762856.069374:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762856.069375:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460200, rc 0) 00000100:00100000:2.0:1789762856.069402:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10463:x1876702246538240:12345-192.168.203.36@tcp:101:rm.0 Request processed in 168us (289us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789762856.069407:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:1.0:1789762856.070398:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762856.070454:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246538368 00000100:00100000:0.0:1789762856.070460:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246538368 00000100:00100000:0.0:1789762856.070492:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:0.0:1789762856.070498:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10463:x1876702246538368:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:0.0:1789762856.070526:0:5924:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7742480384 avail 7279435776 00000100:00100000:0.0:1789762856.070566:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10463:x1876702246538368:12345-192.168.203.36@tcp:41:rm.0 Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762856.070587:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:1.0:1789762856.071560:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762856.071625:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246538624 00000100:00100000:2.0:1789762856.071630:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246538624 00000100:00100000:2.0:1789762856.071659:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:2.0:1789762856.071665:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:10463:x1876702246538624:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762856.071686:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789762856.071698:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2a00/0x5915dfb1c1b59b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894456f expref: 16 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071710:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f75e2800/0x5915dfb1c1b5981b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944561 expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071719:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f4643200/0x5915dfb1c1b597c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944545 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071725:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33fed74c00) 00010000:00010000:2.0:1789762856.071741:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894457d expref: 13 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071747:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:2.0:1789762856.071767:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762856.071777:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071784:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071789:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071798:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071802:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071807:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071855:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071860:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.071865:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762856.072007:0:7598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789762856.072021:0:7598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 158509269074ns, next at 159509267786ns, rc = 0 00010000:00010000:2.0:1789762856.072047:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072054:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072060:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072064:0:7598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072069:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072073:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072087:0:7598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762856.072096:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072101:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072105:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072110:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762856.072114:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072117:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762856.072124:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072129:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072133:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762856.072141:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33ed2a9900) 00010000:00010000:0.0:1789762856.072142:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072147:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762856.072153:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072155:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072160:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59e34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072171:0:6926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b33ed2a9900) 00010000:00010000:0.0:1789762856.072175:0:6926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762856.072175:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072180:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072185:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072190:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072194:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072200:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762856.072203:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072207:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072209:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762856.072213:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762856.072215:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762856.072215:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:2.0:1789762856.072218:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762856.072234:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.072246:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762856.072254:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000accaffde reply state 00000000e0d20f08 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762856.072260:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762856.072293:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10463:x1876702246538624:12345-192.168.203.36@tcp:36:rm.0 Request processed in 627us (734us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789762856.072298:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 90 00010000:00010000:0.0:1789762856.072806:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072812:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072817:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072829:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762856.072832:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072836:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072842:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff9b33ed2a9200) 00010000:00010000:0.0:1789762856.072844:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762856.072846:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.072850:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762856.073348:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762856.073411:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246538880 00000100:00100000:3.0:1789762856.073415:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246538880 00000100:00100000:3.0:1789762856.073438:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:3.0:1789762856.073443:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0affc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:10463:x1876702246538880:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762856.073515:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0affc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10463:x1876702246538880:12345-192.168.203.36@tcp:35:rm.0 Request processed in 71us (168us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789762856.073520:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:1.0:1789762856.074260:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762856.074296:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246539136 00000100:00100000:0.0:1789762856.074301:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246539136 00000100:00100000:0.0:1789762856.074328:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:0.0:1789762856.074332:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10463:x1876702246539136:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762856.074353:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762856.074363:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894458b expref: 14 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074374:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efa00/0x5915dfb1c1b5978f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944537 expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074380:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33d0148f00) 00010000:00010000:0.0:1789762856.074388:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eea00/0x5915dfb1c1b5972d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944522 expref: 12 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074400:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33d0148400) 00010000:00010000:0.0:1789762856.074405:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762856.074415:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074421:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074427:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074434:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074439:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074443:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074475:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074480:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074484:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762856.074587:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1789762856.074597:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074609:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074614:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074618:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eec00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762856.074620:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074624:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074630:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b33fed74500) 00010000:00010000:0.0:1789762856.074631:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762856.074633:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074637:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13eec00/0x5915dfb1c1b59e50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074648:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074652:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074656:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074659:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762856.074665:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074669:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074674:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74200) 00010000:00010000:0.0:1789762856.074675:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762856.074677:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.074680:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b59e42 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762856.074687:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f099c5f reply state 0000000077517c34 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762856.074692:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762856.074726:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:10463:x1876702246539136:12345-192.168.203.36@tcp:36:rm.0 Request processed in 391us (467us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789762856.074733:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 91 00010000:00010000:0.0:1789762856.075339:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.075348:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.075355:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.075361:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762856.075365:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.075380:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.075390:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33fed74900) 00010000:00010000:0.0:1789762856.075392:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762856.075396:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.075403:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b59e49 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.827850:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789762856.863878:0:12302:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 159301124726ns, next at 159509267786ns, rc = 0 00080000:00080000:3.0:1789762856.863892:0:12302:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789762856.865081:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1789762856.865105:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789762856.865116:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1789762856.865201:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254907008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762856.865273:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762856.865319:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907008 00000100:00100000:0.0:1789762856.865327:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907008 00000100:00100000:0.0:1789762856.865378:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789762856.865391:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fc7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254907008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789762856.865418:0:6912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789762856.865447:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 104857600, mtime: 0x6aad9d14, atime: 0x6aad9d00, ctime: 0x6aad9d14, blocks: 0x32000 00010000:00010000:0.0:1789762856.865456:0:6912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.865473:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=159s v=(0 0) 00010000:00010000:0.0:1789762856.865478:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762856.865485:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.865515:0:6912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.865526:0:6912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.865534:0:6912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762856.865559:0:6912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762856.865570:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762856.865576:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.865584:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ee800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762856.865588:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.865596:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.865610:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.865616:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b59e57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762856.865637:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762856.865639:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762856.865640:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762856.865708:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fc7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254907008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 318us (431us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789762856.865717:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1789762856.865728:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c4d75180/2, rc 0, transno 4294967414 00000100:00100000:2.0:1789762856.865740:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254907008:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789762856.865977:0:12302:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 159303224188ns, next at 121288164296ns, rc = 0 00080000:00080000:1.0:1789762856.865989:0:12302:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789762856.866426:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:3.0:1789762857.850907:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762858.810915:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254907392:0@lo:400:kworker.0 00000100:00100000:2.0:1789762858.810916:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254907264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762858.810932:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254907136:0@lo:400:kworker.0 00000100:00100000:3.0:1789762858.810949:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254907520:0@lo:400:kworker.0 00000100:00100000:1.0:1789762858.811014:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762858.811014:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762858.811018:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762858.811079:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907392 00000100:00100000:3.0:1789762858.811086:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907392 00000100:00100000:2.0:1789762858.811103:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254907648:0@lo:400:kworker.0 00000100:00100000:0.0:1789762858.811109:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254907776:0@lo:400:kworker.0 00000100:00100000:1.0:1789762858.811113:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789762858.811139:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789762858.811140:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762858.811157:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254907392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762858.811163:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907136 00000100:00100000:1.0:1789762858.811167:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907136 00000100:00100000:0.0:1789762858.811170:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762858.811224:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789762858.811227:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907264 00000100:00100000:2.0:1789762858.811232:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907264 00000100:00100000:3.0:1789762858.811238:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254907392:12345-0@lo:400:kworker.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762858.811239:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254907136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762858.811261:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789762858.811265:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907776 00000100:00100000:0.0:1789762858.811272:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907776 00000100:00100000:2.0:1789762858.811291:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789762858.811296:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762858.811302:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254907264:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789762858.811303:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762858.811318:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254907136:12345-0@lo:400:kworker.0 Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762858.811322:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00002000:00000024:2.0:1789762858.811327:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762858.811331:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789762858.811337:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254907776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762858.811349:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907648 00000100:00100000:3.0:1789762858.811354:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907648 00000100:00100000:1.0:1789762858.811375:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762858.811384:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254907264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762858.811395:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789762858.811396:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254907776:12345-0@lo:400:kworker.0 Request processed in 60us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762858.811405:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789762858.811406:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907904 00000100:00100000:3.0:1789762858.811410:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907904 00000100:00100000:1.0:1789762858.811426:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254907392:0@lo:400:kworker.0 00000100:00100000:2.0:1789762858.811433:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789762858.811441:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789762858.811446:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254907648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762858.811453:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254907904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762858.811473:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254907136:0@lo:400:kworker.0 00000100:00100000:0.0:1789762858.811492:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254907776:0@lo:400:kworker.0 00000100:00100000:1.0:1789762858.811499:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762858.811500:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254907648:12345-0@lo:400:kworker.0 Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762858.811508:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789762858.811516:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254907904:12345-0@lo:400:kworker.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762858.811525:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789762858.811549:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254907520 00000100:00080000:3.0:1789762858.811549:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762858.811554:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254907648:0@lo:400:kworker.0 00000100:00100000:1.0:1789762858.811555:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254907520 00000100:00100000:0.0:1789762858.811564:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254907904:0@lo:400:kworker.0 00000100:00080000:3.0:1789762858.811581:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762858.811590:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254907264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762858.811602:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789762858.811609:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254907520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762858.811644:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254907520:12345-0@lo:400:kworker.0 Request processed in 37us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762858.811649:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789762858.811674:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254907520:0@lo:400:kworker.0 00010000:00010000:2.0:1789762858.874872:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762859.395820:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762859.395865:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762859.395866:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246539392 00000100:00100000:3.0:1789762859.395877:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246539392 00000100:00100000:1.0:1789762859.395893:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762859.395913:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246539264 00000100:00100000:1.0:1789762859.395919:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762859.395921:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246539264 00000100:00100000:3.0:1789762859.395953:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246539648 00000100:00100000:3.0:1789762859.395960:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246539648 00000100:00100000:2.0:1789762859.395967:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:0.0:1789762859.395978:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246539520 00000100:00100000:2.0:1789762859.395979:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246539264:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762859.395985:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246539520 00000100:00100000:3.0:1789762859.396002:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:3.0:1789762859.396016:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246539392:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762859.396024:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:0.0:1789762859.396031:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:2.0:1789762859.396044:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246539264:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.396050:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246539520:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762859.396051:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246539648:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762859.396061:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:3.0:1789762859.396088:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246539392:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.396102:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246539520:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 57us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762859.396103:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:1.0:1789762859.396111:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246539648:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762859.396117:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:1.0:1789762859.396124:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00080000:2.0:1789762859.396127:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762859.396133:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789762859.898894:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762860.859004:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762860.859042:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254908032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762860.859112:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762860.859159:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908032 00000100:00100000:1.0:1789762860.859169:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908032 00000100:00080000:2.0:1789762860.859235:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762860.859251:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789762860.859264:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254908032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762860.859295:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762860.859351:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254908032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762860.859360:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789762860.859405:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254908032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762860.922918:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762861.946953:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789762862.395954:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967414 is committed 00010000:00010000:2.0:1789762862.970881:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762863.930914:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254908288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762863.930928:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254908160:0@lo:400:kworker.0 00000100:00100000:0.0:1789762863.930948:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254908416:0@lo:400:kworker.0 00000100:00100000:1.0:1789762863.931026:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762863.931040:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762863.931049:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762863.931122:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254908928:0@lo:400:kworker.0 00000100:00100000:1.0:1789762863.931130:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254908800:0@lo:400:kworker.0 00000100:00100000:2.0:1789762863.931143:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254908672:0@lo:400:kworker.0 00000100:00100000:0.0:1789762863.931193:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762863.931228:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762863.931240:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762863.931282:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762863.931304:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254908544:0@lo:400:kworker.0 00000100:00100000:1.0:1789762863.931337:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908160 00000100:00100000:1.0:1789762863.931347:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908160 00000100:00100000:2.0:1789762863.931356:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908288 00000100:00100000:0.0:1789762863.931362:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762863.931370:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908288 00000100:00100000:1.0:1789762863.931418:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789762863.931456:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908416 00000100:00100000:1.0:1789762863.931456:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254908160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762863.931462:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908416 00000100:00100000:2.0:1789762863.931489:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789762863.931519:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254908288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762863.931547:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254908160:12345-0@lo:400:kworker.0 Request processed in 115us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762863.931560:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789762863.931567:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908800 00002000:00000024:2.0:1789762863.931567:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762863.931590:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908800 00000100:00100000:1.0:1789762863.931610:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908544 00000100:00100000:1.0:1789762863.931634:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908544 00000100:00100000:2.0:1789762863.931666:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254908288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762863.931673:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789762863.931696:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789762863.931704:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789762863.931714:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254908416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762863.931731:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254908800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762863.931802:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908928 00000100:00100000:2.0:1789762863.931811:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908928 00000100:00100000:1.0:1789762863.931819:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254908800:12345-0@lo:400:kworker.0 Request processed in 94us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762863.931851:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254908416:12345-0@lo:400:kworker.0 Request processed in 147us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762863.931877:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254908672 00000100:00100000:1.0:1789762863.931878:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789762863.931885:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254908672 00000100:00100000:0.0:1789762863.931891:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789762863.931912:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789762863.931928:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254908544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762863.931953:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789762863.931963:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789762863.931971:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254908928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762863.931974:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254908544:12345-0@lo:400:kworker.0 Request processed in 47us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762863.931985:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789762863.931994:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254908672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762863.932021:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254908928:12345-0@lo:400:kworker.0 Request processed in 58us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762863.932029:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789762863.932056:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254908800:0@lo:400:kworker.0 00000100:00100000:2.0:1789762863.932070:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254908672:12345-0@lo:400:kworker.0 Request processed in 85us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762863.932078:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254908544:0@lo:400:kworker.0 00000100:00100000:2.0:1789762863.932095:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789762863.932104:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254908288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762863.932141:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254908416:0@lo:400:kworker.0 00000100:00080000:2.0:1789762863.932177:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762863.932183:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254908928:0@lo:400:kworker.0 00000100:00080000:2.0:1789762863.932187:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789762863.932198:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762863.932302:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254908160:0@lo:400:kworker.0 00000100:00100000:0.0:1789762863.932322:0:3419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967414 gen 2 00000004:00080000:0.0:1789762863.932328:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c4d75180, transno 4294967414 00000100:00100000:0.0:1789762863.932352:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254908672:0@lo:400:kworker.0 00010000:00010000:2.0:1789762863.994928:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762864.515841:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762864.515872:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762864.515892:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762864.515926:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762864.515935:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246539776 00000100:00100000:2.0:1789762864.515952:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246539776 00000100:00100000:3.0:1789762864.515960:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540032 00000100:00100000:1.0:1789762864.515961:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246539904 00000100:00100000:0.0:1789762864.515968:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540160 00000100:00100000:1.0:1789762864.515973:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246539904 00000100:00100000:3.0:1789762864.515973:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540032 00000100:00100000:0.0:1789762864.515976:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540160 00000100:00100000:2.0:1789762864.516031:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 239 00000100:00100000:2.0:1789762864.516050:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246539776:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762864.516081:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:3.0:1789762864.516088:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:1.0:1789762864.516092:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:0.0:1789762864.516101:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246540160:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762864.516103:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246540032:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762864.516115:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246539904:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762864.516144:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246539776:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 96us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762864.516155:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 239 00000100:00100000:0.0:1789762864.516172:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246540160:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762864.516195:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246540032:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 91us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762864.516197:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246539904:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 86us (315us total) trans 0 rc 0/0 00000100:00080000:2.0:1789762864.516221:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762864.516235:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00080000:2.0:1789762864.516237:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762864.516244:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:1.0:1789762864.516255:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00010000:00010000:3.0:1789762865.018910:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789762865.966513:0:12767:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789762865.966519:0:12767:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1789762865.978748:0:12774:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789762865.978918:0:12774:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1789762865.979855:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f75e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254909056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762865.979921:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762865.979964:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909056 00000100:00100000:0.0:1789762865.979973:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909056 00000100:00080000:2.0:1789762865.980001:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762865.980037:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789762865.980048:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254909056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762865.980074:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762865.980123:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254909056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762865.980129:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789762865.980168:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f75e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254909056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762866.042859:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762866.299377:0:12832:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff9b33f767ee00 key uid={0} rule@0xffff9b33fee79100 gen 0 rate 10000 depth 3 token 2 deadline 118172390564 time 118224908123 state 0x6 ref 0 00000100:00100000:2.0:1789762866.299396:0:12832:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff9b33f7744000 key uid={500} rule@0xffff9b33fee79600 gen 0 rate 5 depth 3 token 0 deadline 158457348489 time 158457461483 state 0x6 ref 0 00010000:00010000:2.0:1789762867.066893:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762868.090975:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762869.050997:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254909312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762869.051018:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254909568:0@lo:400:kworker.0 00000100:00100000:3.0:1789762869.051043:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254909184:0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.051072:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254909440:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.051120:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762869.051133:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762869.051137:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762869.051214:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254909824:0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.051219:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909568 00000100:00100000:0.0:1789762869.051228:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254909696:0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.051241:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909568 00000100:00100000:1.0:1789762869.051252:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909184 00000100:00100000:3.0:1789762869.051257:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762869.051261:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909184 00000100:00100000:0.0:1789762869.051279:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762869.051323:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909824 00000100:00100000:3.0:1789762869.051328:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909824 00000100:00100000:2.0:1789762869.051331:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789762869.051334:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789762869.051346:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254909568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.051352:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254909184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762869.051364:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909312 00000100:00100000:0.0:1789762869.051369:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909312 00000100:00100000:3.0:1789762869.051371:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789762869.051382:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254909824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762869.051420:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789762869.051427:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254909568:12345-0@lo:400:kworker.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762869.051432:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254909312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762869.051446:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254909184:12345-0@lo:400:kworker.0 Request processed in 93us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.051454:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254909824:12345-0@lo:400:kworker.0 Request processed in 61us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.051455:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789762869.051465:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00002000:00000024:0.0:1789762869.051474:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762869.051475:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789762869.051491:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909696 00000100:00100000:2.0:1789762869.051496:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909696 00000100:00080000:3.0:1789762869.051508:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762869.051513:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762869.051518:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762869.051528:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254909312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762869.051540:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789762869.051541:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789762869.051553:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254909696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762869.051555:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254909184:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.051564:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762869.051585:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254909824:0@lo:400:kworker.0 00000100:00100000:0.0:1789762869.051592:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254909312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762869.051605:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254909952:0@lo:400:kworker.0 00000100:00100000:2.0:1789762869.051612:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254909696:12345-0@lo:400:kworker.0 Request processed in 60us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.051620:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789762869.051636:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254909696:0@lo:400:kworker.0 00000100:00100000:3.0:1789762869.051645:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254909568:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.051652:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762869.051661:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909440 00000100:00100000:2.0:1789762869.051666:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909440 00000100:00100000:3.0:1789762869.051693:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254909952 00000100:00100000:3.0:1789762869.051698:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254909952 00000100:00100000:0.0:1789762869.051717:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789762869.051731:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254909440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762869.051731:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789762869.051785:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254909952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762869.051810:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254909440:12345-0@lo:400:kworker.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762869.051817:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789762869.051830:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254909952:12345-0@lo:400:kworker.0 Request processed in 87us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.051836:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789762869.051853:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254909440:0@lo:400:kworker.0 00000100:00100000:1.0:1789762869.051867:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254909952:0@lo:400:kworker.0 00010000:00010000:3.0:1789762869.114944:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762869.635874:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.635936:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540288 00000100:00100000:1.0:1789762869.635962:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540288 00000100:00100000:0.0:1789762869.635974:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.636050:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:0.0:1789762869.636062:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.636075:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246540288:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762869.636166:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246540288:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.636197:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:0.0:1789762869.636206:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762869.636436:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540416 00000100:00100000:0.0:1789762869.636448:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540416 00000100:00100000:0.0:1789762869.636524:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540672 00000100:00100000:0.0:1789762869.636528:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540672 00000100:00100000:0.0:1789762869.636564:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:0.0:1789762869.636578:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246540416:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:1.0:1789762869.636612:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762869.636636:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1789762869.636649:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246540672:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762869.636676:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246540416:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 98us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762869.636688:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:1.0:1789762869.636703:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246540672:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 56us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.636714:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1789762869.636798:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540544 00000100:00100000:1.0:1789762869.636803:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540544 00000100:00100000:1.0:1789762869.636853:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1789762869.636867:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246540544:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762869.636903:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246540544:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.636908:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00080000:1.0:1789762869.636962:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762869.753225:0:12880:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762869.753234:0:12880:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f7241b00 rate 10000 gen 0 00000100:00100000:1.0:1789762869.753270:0:12880:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762869.753274:0:12880:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f7241800 rate 10000 gen 0 00000100:00100000:1.0:1789762869.753402:0:12880:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X10, dynamic 0, field: gid, str: 500 00000100:00100000:1.0:1789762869.753411:0:12880:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762869.753414:0:12880:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X10, dynamic 0, field: gid, str: 500 00000100:00100000:1.0:1789762869.753417:0:12880:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f7241600 rate 5 gen 0 00000100:00100000:1.0:1789762869.753419:0:12880:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:1.0:1789762869.753422:0:12880:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X10, dynamic 0, field: gid, str: 500 00000100:00100000:1.0:1789762869.753424:0:12880:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f7241300 rate 5 gen 0 00000100:00100000:0.0:1789762869.772051:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.772133:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540800 00000100:00100000:3.0:1789762869.772144:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540800 00000100:00100000:3.0:1789762869.772202:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:3.0:1789762869.772212:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:11015:x1876702246540800:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:3.0:1789762869.772231:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762869.772300:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59e5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944592 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.772368:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5400/0x5915dfb1c1b59e65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.772394:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5400/0x5915dfb1c1b59e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.772409:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5400/0x5915dfb1c1b59e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762869.772455:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762869.772458:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762869.772474:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5400/0x5915dfb1c1b59e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.772497:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59e5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944592 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.772511:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5400/0x5915dfb1c1b59e65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944592 expref: 6 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.772518:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49800) 00010000:00010000:3.0:1789762869.772520:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762869.772523:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5400, rc 0) 00000100:00100000:3.0:1789762869.772579:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:11015:x1876702246540800:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 370us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.772584:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:0.0:1789762869.775021:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.775087:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246540928 00000100:00100000:1.0:1789762869.775094:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246540928 00000100:00100000:1.0:1789762869.775151:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:1.0:1789762869.775162:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246540928:12345-192.168.203.36@tcp:41:mkdir.0 00000100:00100000:0.0:1789762869.775183:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000004:00000024:1.0:1789762869.775189:0:5925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1789762869.775242:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246541184 00000100:00100000:1.0:1789762869.775246:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246540928:12345-192.168.203.36@tcp:41:mkdir.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.775248:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246541184 00000100:00100000:1.0:1789762869.775257:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:1.0:1789762869.775282:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:1.0:1789762869.775302:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:11015:x1876702246541184:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:1.0:1789762869.775343:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762869.775368:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5400/0x5915dfb1c1b59e65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944592 expref: 6 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775385:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49800) 00010000:00010000:1.0:1789762869.775397:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762869.775439:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775446:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775451:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775460:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775465:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775470:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762869.775925:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1789762869.775936:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775944:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775952:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775964:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762869.775967:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775973:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775981:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535f00) 00010000:00010000:1.0:1789762869.775983:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762869.775986:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.775990:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59e6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762869.776004:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000027c6a38 reply state 00000000368d249c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762869.776010:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762869.776057:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:11015:x1876702246541184:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 768us (879us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789762869.776063:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 94 00010000:00010000:1.0:1789762869.776896:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.776903:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.776910:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.776923:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762869.776926:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.776931:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.776939:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33f4535d00) 00010000:00010000:1.0:1789762869.776941:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762869.776943:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.776947:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59e73 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.786915:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.786959:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246541312 00000100:00100000:2.0:1789762869.786966:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246541312 00000100:00100000:2.0:1789762869.787002:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:2.0:1789762869.787020:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:11016:x1876702246541312:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762869.787039:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.787051:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944599 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.787080:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.787087:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.787103:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.787134:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762869.787137:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762869.787148:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.787161:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944599 expref: 8 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.787171:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944599 expref: 7 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.787176:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9b00) 00010000:00010000:2.0:1789762869.787178:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762869.787180:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460200, rc 0) 00000100:00100000:2.0:1789762869.787213:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:11016:x1876702246541312:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 205us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.787218:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:0.0:1789762869.789512:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.789560:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246541568 00000100:00100000:2.0:1789762869.789568:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246541568 00000100:00100000:2.0:1789762869.789602:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:2.0:1789762869.789612:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:11016:x1876702246541568:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762869.789621:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.789622:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762869.789634:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944599 expref: 7 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789650:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9b00) 00010000:00010000:2.0:1789762869.789659:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762869.789671:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445a0 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789738:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789745:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789780:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789798:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789807:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789817:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789900:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789906:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789911:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.789917:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00010000:00010000:2.0:1789762869.789925:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789931:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789938:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789943:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.789947:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789954:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789963:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762869.789967:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.789970:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.789989:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790005:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790009:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790014:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790017:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.790020:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790024:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790030:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:2.0:1789762869.790032:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.790033:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790037:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790043:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790047:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790056:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790061:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.790063:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790067:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790072:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.790073:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.790075:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790079:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59e96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790098:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e88 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445a0 expref: 7 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790104:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:2.0:1789762869.790106:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.790109:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59e88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445a0 expref: 7 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.790131:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461800, rc 0) 00000100:00100000:2.0:1789762869.790181:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:11016:x1876702246541568:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 570us (676us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762869.790195:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:0.0:1789762869.791735:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.791830:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246541696 00000100:00100000:2.0:1789762869.791837:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246541696 00000100:00100000:2.0:1789762869.791878:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:2.0:1789762869.791886:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:11016:x1876702246541696:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762869.791894:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.791904:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445a7 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.791929:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59eab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.791940:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.791950:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.791971:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762869.791975:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762869.791986:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.792004:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445a7 expref: 8 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.792015:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445a7 expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.792029:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:2.0:1789762869.792031:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762869.792033:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461c00, rc 0) 00000100:00100000:2.0:1789762869.792066:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:11016:x1876702246541696:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 183us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.792071:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:0.0:1789762869.793711:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.793836:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246541952 00000100:00100000:1.0:1789762869.793847:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246541952 00000100:00100000:1.0:1789762869.793883:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:1.0:1789762869.793891:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:11016:x1876702246541952:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762869.793899:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762869.793906:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59eb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445ae expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.793936:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.793943:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.793949:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.793968:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.793974:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.793978:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762869.794014:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1789762869.794051:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794056:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794060:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794064:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762869.794066:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794070:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794077:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:1.0:1789762869.794079:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762869.794081:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794094:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794103:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794107:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794111:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794115:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762869.794133:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794140:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794149:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33f4535d00) 00010000:00010000:1.0:1789762869.794153:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762869.794156:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794163:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59ec0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794190:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59eb2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ae expref: 9 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794208:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:1.0:1789762869.794210:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762869.794213:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59eb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ae expref: 9 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.794220:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7000, rc 0) 00000100:00100000:1.0:1789762869.794254:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:11016:x1876702246541952:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 364us (549us total) trans 4294967358 rc 301/301 00000100:00100000:1.0:1789762869.794259:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:0.0:1789762869.795713:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.795779:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246542208 00000100:00100000:1.0:1789762869.795785:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246542208 00000100:00100000:1.0:1789762869.795821:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:1.0:1789762869.795828:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:11016:x1876702246542208:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:1.0:1789762869.795864:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.795872:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.795879:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762869.795953:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2c8b3a7 reply state 000000005892cb86 transno 4294967359 ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762869.795960:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762869.795963:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00000100:00100000:1.0:1789762869.796006:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:11016:x1876702246542208:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 180us (301us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1789762869.796017:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 99 00010000:00010000:2.0:1789762869.797039:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.797048:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.797052:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.797056:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.797058:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.797062:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.797069:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33f4535f00) 00010000:00010000:2.0:1789762869.797071:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789762869.797073:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.797077:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ece lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.797273:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.797340:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246542464 00000100:00100000:2.0:1789762869.797347:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246542464 00000100:00100000:2.0:1789762869.797382:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1789762869.797391:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:11016:x1876702246542464:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1789762869.797498:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:11016:x1876702246542464:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 107us (234us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789762869.797508:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:3.0:1789762869.803988:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.804011:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246542592 00000100:00100000:3.0:1789762869.804015:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246542592 00000100:00100000:3.0:1789762869.804039:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:3.0:1789762869.804045:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:11017:x1876702246542592:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:3.0:1789762869.804063:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762869.804072:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59ed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445b5 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804103:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804112:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804136:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804147:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804153:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804158:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804199:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5000/0x5915dfb1c1b59eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804204:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5000/0x5915dfb1c1b59eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804212:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5000/0x5915dfb1c1b59eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762869.804233:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00000004:00200000:3.0:1789762869.804242:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762869.804254:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5000/0x5915dfb1c1b59eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804261:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804266:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804270:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804274:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762869.804277:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804281:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804288:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:3.0:1789762869.804290:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762869.804293:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804296:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59edc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804304:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804308:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804322:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804325:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762869.804327:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804331:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804337:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33e2f49f00) 00010000:00010000:3.0:1789762869.804338:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762869.804340:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804344:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59ee3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804373:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59ed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445b5 expref: 12 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804383:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5000/0x5915dfb1c1b59eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445b5 expref: 11 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.804388:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33e2f49b00) 00010000:00010000:3.0:1789762869.804389:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762869.804391:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5000, rc 0) 00000100:00100000:3.0:1789762869.804430:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11017:x1876702246542592:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 383us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.804451:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:0.0:1789762869.806148:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.806203:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246542848 00000100:00100000:2.0:1789762869.806209:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246542848 00000100:00100000:2.0:1789762869.806244:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:2.0:1789762869.806251:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11017:x1876702246542848:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:2.0:1789762869.806273:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762869.806290:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5000/0x5915dfb1c1b59eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445b5 expref: 11 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.806301:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33e2f49b00) 00010000:00010000:2.0:1789762869.806306:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762869.806316:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.806323:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.806328:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762869.806428:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049d24471 reply state 00000000cd455328 transno 4294967361 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.806439:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762869.806443:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00000100:00100000:2.0:1789762869.806487:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:11017:x1876702246542848:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 237us (370us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789762869.806494:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 101 00010000:00010000:2.0:1789762869.807315:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.807324:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.807329:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.807334:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.807337:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.807341:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.807351:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:2.0:1789762869.807353:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762869.807356:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.807360:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.825413:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.825472:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246542976 00000100:00100000:2.0:1789762869.825485:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246542976 00000100:00100000:2.0:1789762869.825520:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:2.0:1789762869.825526:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11021:x1876702246542976:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:2.0:1789762869.825537:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.825546:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445bc expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825580:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825589:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825595:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825602:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825607:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825612:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825680:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825685:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825690:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.825711:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1789762869.825714:0:7598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762869.825724:0:7598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825730:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825735:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825739:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825743:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.825746:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825779:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825791:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:2.0:1789762869.825794:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.825798:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825805:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59eff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825818:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825834:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825838:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825842:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.825844:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825848:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825853:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33ed2a9a00) 00010000:00010000:2.0:1789762869.825855:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.825857:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825861:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59f06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825881:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59ef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445bc expref: 13 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825889:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445bc expref: 12 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.825894:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.825896:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789762869.825901:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460400, rc 0) 00000100:00100000:2.0:1789762869.825934:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:11021:x1876702246542976:12345-192.168.203.36@tcp:101:touch.500 Request processed in 409us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.825940:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:0.0:1789762869.826977:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.827011:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246543232 00000100:00100000:2.0:1789762869.827016:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246543232 00000100:00100000:2.0:1789762869.827043:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:2.0:1789762869.827049:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:11021:x1876702246543232:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:2.0:1789762869.827056:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.827063:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59f14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445c3 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827107:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827114:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827134:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827164:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827179:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827183:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762869.827432:0:9183:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00000004:00080000:2.0:1789762869.827443:0:9183:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789762869.827526:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827533:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827538:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827557:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827561:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827565:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827569:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.827571:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827575:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827579:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.827581:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.827583:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827587:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59f1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762869.827601:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b40b61 reply state 00000000388245ed transno 4294967362 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.827607:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762869.827622:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59f14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445c3 expref: 15 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827630:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445c3 expref: 14 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.827635:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33ed2a9b00) 00010000:00010000:2.0:1789762869.827636:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762869.827638:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461000, rc 0) 00000100:00100000:2.0:1789762869.827666:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:11021:x1876702246543232:12345-192.168.203.36@tcp:101:touch.500 Request processed in 617us (691us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789762869.827671:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 103 00010000:00010000:2.0:1789762869.828272:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.828279:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.828283:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.828286:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.828288:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.828301:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.828308:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x3950208a (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762869.828309:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.828311:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.828315:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.828905:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.828947:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246543488 00000100:00100000:1.0:1789762869.828953:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246543488 00000100:00100000:1.0:1789762869.828984:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:1.0:1789762869.828992:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:11021:x1876702246543488:12345-192.168.203.36@tcp:36:touch.500 00010000:00010000:1.0:1789762869.829014:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762869.829024:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b59f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445c3 expref: 14 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.829034:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33ed2a9b00) 00010000:00010000:1.0:1789762869.829039:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762869.829058:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.829066:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.829071:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762869.829107:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059f56b5a reply state 0000000093d4acba transno 4294967363 ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762869.829113:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762869.829176:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:11021:x1876702246543488:12345-192.168.203.36@tcp:36:touch.500 Request processed in 185us (271us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789762869.829184:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 104 00010000:00010000:2.0:1789762869.829650:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.829656:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.829660:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.829664:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.829666:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.829670:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.829676:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535d00) 00010000:00010000:2.0:1789762869.829678:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.829680:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.829691:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7000/0x5915dfb1c1b59f37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.831045:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.831075:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246543616 00000100:00100000:1.0:1789762869.831086:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246543616 00000100:00100000:1.0:1789762869.831113:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:1.0:1789762869.831130:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:11021:x1876702246543616:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:1.0:1789762869.831138:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762869.831146:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59f3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445ca expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.831170:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ca expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.831177:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ca expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.831188:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:1.0:1789762869.831190:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789762869.831192:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f6400, rc 0) 00000100:00100000:1.0:1789762869.831218:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:11021:x1876702246543616:12345-192.168.203.36@tcp:101:touch.500 Request processed in 99us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.831226:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:3.0:1789762869.832074:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.832147:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246543744 00000100:00100000:2.0:1789762869.832153:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246543744 00000100:00100000:2.0:1789762869.832185:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:2.0:1789762869.832191:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246543744:12345-192.168.203.36@tcp:2:touch.500 00000100:00100000:2.0:1789762869.832307:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246543744:12345-192.168.203.36@tcp:2:touch.500 Request processed in 115us (233us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789762869.832313:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:1.0:1789762869.832416:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.832491:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246543872 00000100:00100000:3.0:1789762869.832498:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246543872 00000100:00100000:3.0:1789762869.832531:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:3.0:1789762869.832539:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876702246543872:12345-192.168.203.36@tcp:8:touch.500 00010000:00080000:3.0:1789762869.832563:0:6912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:3.0:1789762869.832588:0:6912:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b59f45 00002000:00100000:3.0:1789762869.832599:0:6912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f07ac6c5-9215-4651-bbbc-5b452d5bdd86/ffff9b32c547f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 42041344 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789762869.832610:0:6912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789762869.832654:0:6912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789762869.832682:0:6912:0:(import.c:65:import_set_state_nolock()) ffff9b32c547b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789762869.832724:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246543872:12345-192.168.203.36@tcp:8:touch.500 Request processed in 184us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.832732:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:0.0:1789762869.833518:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.833554:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246544000 00000100:00100000:1.0:1789762869.833559:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246544000 00000100:00100000:1.0:1789762869.833594:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1789762869.833601:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:0:x1876702246544000:12345-192.168.203.36@tcp:2:touch.500 00000100:00080000:2.0:1789762869.833603:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789762869.834542:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00100000:2.0:1789762869.834548:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000100:00100000:1.0:1789762869.834631:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:0:x1876702246544000:12345-192.168.203.36@tcp:2:touch.500 Request processed in 1027us (1110us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789762869.834640:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:0.0:1789762869.835436:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.835484:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246544256 00000100:00100000:2.0:1789762869.835489:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246544256 00000100:00100000:2.0:1789762869.835521:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:2.0:1789762869.835528:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:11021:x1876702246544256:12345-192.168.203.36@tcp:35:touch.500 00000100:00100000:2.0:1789762869.835647:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:11021:x1876702246544256:12345-192.168.203.36@tcp:35:touch.500 Request processed in 119us (211us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789762869.835655:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:0.0:1789762869.852939:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.852983:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246544512 00000100:00100000:3.0:1789762869.852991:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246544512 00000100:00100000:3.0:1789762869.853024:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:3.0:1789762869.853032:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:11025:x1876702246544512:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:3.0:1789762869.853045:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762869.853056:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59f4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445d1 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853148:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853169:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853177:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853187:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853192:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853196:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762869.853431:0:5925:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00000004:00080000:3.0:1789762869.853438:0:5925:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789762869.853533:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b59f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853540:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b59f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853545:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b59f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853564:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853568:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853581:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853585:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762869.853588:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853593:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853600:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:3.0:1789762869.853602:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762869.853605:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853609:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59f53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762869.853617:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fce029a5 reply state 0000000068c0f284 transno 4294967365 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762869.853622:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762869.853639:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b59f4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445d1 expref: 19 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853649:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b59f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445d1 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.853654:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33e2f49000) 00010000:00010000:3.0:1789762869.853655:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762869.853661:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5a00, rc 0) 00000100:00100000:3.0:1789762869.853707:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:11025:x1876702246544512:12345-192.168.203.36@tcp:101:touch.500 Request processed in 675us (770us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789762869.853716:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 106 00010000:00010000:2.0:1789762869.854421:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.854433:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.854439:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.854449:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.854452:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.854456:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.854463:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x25a23cf0 (ffff9b33e2f49f00) 00010000:00010000:2.0:1789762869.854465:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.854467:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.854471:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b59f5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.854863:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.854895:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246544768 00000100:00100000:2.0:1789762869.854900:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246544768 00000100:00100000:2.0:1789762869.854929:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:2.0:1789762869.854935:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:11025:x1876702246544768:12345-192.168.203.36@tcp:36:touch.500 00010000:00010000:2.0:1789762869.854957:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762869.854968:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b59f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445d1 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.854978:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33e2f49000) 00010000:00010000:2.0:1789762869.854982:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762869.855001:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.855008:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.855019:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762869.855059:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a064e2fe reply state 00000000946029a0 transno 4294967366 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.855065:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762869.855107:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:11025:x1876702246544768:12345-192.168.203.36@tcp:36:touch.500 Request processed in 172us (245us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789762869.855112:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 107 00010000:00010000:2.0:1789762869.855612:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.855621:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.855627:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.855632:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.855635:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.855639:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.855647:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762869.855649:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.855652:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.855669:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:2.0:1789762869.855670:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762869.855719:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246544896 00000100:00100000:1.0:1789762869.855726:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246544896 00000100:00100000:1.0:1789762869.855778:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:1.0:1789762869.855788:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:11025:x1876702246544896:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:1.0:1789762869.855801:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762869.855813:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59f76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445d8 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.855844:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445d8 expref: 19 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.855852:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445d8 expref: 19 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.855863:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:1.0:1789762869.855865:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789762869.855867:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7800, rc 0) 00000100:00100000:1.0:1789762869.855896:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:11025:x1876702246544896:12345-192.168.203.36@tcp:101:touch.500 Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.855905:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:0.0:1789762869.856649:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762869.856669:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.856691:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246545024 00000100:00100000:2.0:1789762869.856698:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246545024 00000100:00100000:1.0:1789762869.856715:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246545152 00000100:00100000:1.0:1789762869.856720:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246545152 00000100:00100000:2.0:1789762869.856743:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:1.0:1789762869.856775:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:2.0:1789762869.856781:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246545024:12345-192.168.203.36@tcp:2:touch.500 00000100:00100000:1.0:1789762869.856788:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246545152:12345-192.168.203.36@tcp:2:touch.500 00000100:00100000:1.0:1789762869.856894:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246545152:12345-192.168.203.36@tcp:2:touch.500 Request processed in 111us (223us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789762869.856901:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:2.0:1789762869.856937:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246545024:12345-192.168.203.36@tcp:2:touch.500 Request processed in 182us (284us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789762869.856946:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:0.0:1789762869.857818:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.858176:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246545408 00000100:00100000:2.0:1789762869.858183:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246545408 00000100:00100000:2.0:1789762869.858217:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:2.0:1789762869.858227:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:11025:x1876702246545408:12345-192.168.203.36@tcp:35:touch.500 00000100:00100000:2.0:1789762869.858350:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:11025:x1876702246545408:12345-192.168.203.36@tcp:35:touch.500 Request processed in 126us (535us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789762869.858357:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:0.0:1789762869.872112:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.872175:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246545664 00000100:00100000:2.0:1789762869.872182:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246545664 00000100:00100000:2.0:1789762869.872217:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 109 00000100:00100000:2.0:1789762869.872226:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:11029:x1876702246545664:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1789762869.872242:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.872257:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445df expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.872327:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59f84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.872337:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59f84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.872344:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59f84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.872351:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00010000:00010000:2.0:1789762869.872400:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445df expref: 23 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.872410:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59f84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445df expref: 22 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.872416:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.872418:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762869.872421:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461600, rc 0) 00000100:00100000:2.0:1789762869.872452:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:11029:x1876702246545664:12345-192.168.203.36@tcp:101:bash.0 Request processed in 229us (344us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789762869.872457:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 109 00000100:00100000:0.0:1789762869.873369:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.873455:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246545792 00000100:00100000:1.0:1789762869.873460:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246545792 00000100:00100000:1.0:1789762869.873493:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:1.0:1789762869.873500:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:11029:x1876702246545792:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1789762869.873510:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762869.873518:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7a00/0x5915dfb1c1b59f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445e6 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.873561:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b59f99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.873569:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b59f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.873575:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b59f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762869.873593:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00000004:00200000:1.0:1789762869.873595:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762869.873604:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b59f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.873617:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7a00/0x5915dfb1c1b59f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445e6 expref: 24 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.873628:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b59f99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445e6 expref: 23 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.873633:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:1.0:1789762869.873635:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762869.873642:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7400, rc 0) 00000100:00100000:1.0:1789762869.873672:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:11029:x1876702246545792:12345-192.168.203.36@tcp:101:bash.0 Request processed in 172us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.873677:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:0.0:1789762869.874930:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.874963:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246545920 00000100:00100000:2.0:1789762869.874968:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246545920 00000100:00100000:2.0:1789762869.874993:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:2.0:1789762869.875000:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:11029:x1876702246545920:12345-192.168.203.36@tcp:37:bash.0 00000100:00100000:2.0:1789762869.876692:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:11029:x1876702246545920:12345-192.168.203.36@tcp:37:bash.0 Request processed in 1691us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.876702:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:0.0:1789762869.881083:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.881131:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246546048 00000100:00100000:2.0:1789762869.881136:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246546048 00000100:00100000:2.0:1789762869.881164:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:2.0:1789762869.881170:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:11029:x1876702246546048:12345-192.168.203.36@tcp:101:chmod.500 00010000:00010000:2.0:1789762869.881177:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.881185:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59fa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445ed expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881213:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881221:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881226:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881235:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881240:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881244:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881286:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881300:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881305:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.881324:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 0 00000004:00200000:2.0:1789762869.881326:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762869.881345:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881353:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881358:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881362:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881366:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881370:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.881372:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881377:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881384:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.881386:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.881393:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881397:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b59fa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881405:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881409:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881413:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881416:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.881418:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881422:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881426:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x3950208a (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762869.881427:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.881429:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881433:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b59fae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881449:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b59fa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ed expref: 25 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881464:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ed expref: 24 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.881469:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:2.0:1789762869.881471:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762869.881472:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460c00, rc 0) 00000100:00100000:2.0:1789762869.881500:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:11029:x1876702246546048:12345-192.168.203.36@tcp:101:chmod.500 Request processed in 329us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.881508:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:0.0:1789762869.882450:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762869.882474:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.882503:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246546176 00000100:00100000:1.0:1789762869.882508:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246546176 00000100:00100000:3.0:1789762869.882517:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246546304 00000100:00100000:3.0:1789762869.882523:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246546304 00000100:00100000:1.0:1789762869.882545:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:1.0:1789762869.882555:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246546176:12345-192.168.203.36@tcp:101:chmod.500 00000100:00100000:3.0:1789762869.882565:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00010000:00010000:1.0:1789762869.882569:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789762869.882581:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246546304:12345-192.168.203.36@tcp:101:chmod.500 00010000:00010000:1.0:1789762869.882582:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445f4 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.882594:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1789762869.882602:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x0 00010000:00010000:3.0:1789762869.882610:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789445fb expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.882616:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=172s v=(0 0) 00010000:00010000:1.0:1789762869.882622:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00002000:00010000:3.0:1789762869.882627:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x0 00010000:00010000:1.0:1789762869.882630:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 8 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.882639:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=172s v=(0 0) 00010000:00010000:1.0:1789762869.882644:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 8 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.882645:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762869.882659:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 7 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.882661:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7a00, rc 0) 00010000:00010000:3.0:1789762869.882675:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 7 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.882683:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5c00, rc 0) 00000100:00100000:1.0:1789762869.882693:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246546176:12345-192.168.203.36@tcp:101:chmod.500 Request processed in 140us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.882700:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:3.0:1789762869.882709:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246546304:12345-192.168.203.36@tcp:101:chmod.500 Request processed in 134us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762869.882716:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:0.0:1789762869.883873:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.883909:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246546560 00000100:00100000:3.0:1789762869.883920:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246546560 00000100:00100000:3.0:1789762869.883949:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:3.0:1789762869.883958:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:11029:x1876702246546560:12345-192.168.203.36@tcp:36:chmod.500 00010000:00010000:3.0:1789762869.883985:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762869.883999:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b59fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ed expref: 24 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.884010:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:3.0:1789762869.884013:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762869.884026:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.884033:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762869.884039:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762869.884109:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f569fd1 reply state 00000000e1fb2016 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762869.884115:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762869.884174:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:11029:x1876702246546560:12345-192.168.203.36@tcp:36:chmod.500 Request processed in 218us (301us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789762869.884179:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 112 00010000:00010000:2.0:1789762869.884639:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.884648:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.884656:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.884662:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.884666:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.884673:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.884683:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:2.0:1789762869.884686:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762869.884689:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.884703:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b59fca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.884784:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.884809:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246546816 00000100:00100000:2.0:1789762869.884814:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246546816 00000100:00100000:2.0:1789762869.884848:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:2.0:1789762869.884857:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246546816:12345-192.168.203.36@tcp:2:chmod.500 00000100:00100000:0.0:1789762869.884922:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00010000:2.0:1789762869.884945:0:7959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1789762869.884947:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246546688 00002000:00010000:2.0:1789762869.884950:0:7959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789762870 -> 1789762870 00000100:00100000:3.0:1789762869.884952:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246546688 00002000:00010000:2.0:1789762869.884953:0:7959:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789762870 -> 1789762870 00002000:00010000:2.0:1789762869.884955:0:7959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789762870 -> 1789762870 00002000:00010000:2.0:1789762869.884958:0:7959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789762869.884982:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:2.0:1789762869.884990:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246546816:12345-192.168.203.36@tcp:2:chmod.500 Request processed in 135us (205us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789762869.884991:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246546688:12345-192.168.203.36@tcp:2:chmod.500 00000100:00100000:2.0:1789762869.885001:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00002000:00010000:3.0:1789762869.885078:0:12136:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762869.885128:0:12136:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762870 -> 1789762870 00002000:00010000:3.0:1789762869.885130:0:12136:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789762870 -> 1789762870 00002000:00010000:3.0:1789762869.885132:0:12136:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762870 -> 1789762870 00002000:00010000:3.0:1789762869.885133:0:12136:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789762869.885159:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2354:x1876702246546688:12345-192.168.203.36@tcp:2:chmod.500 Request processed in 171us (239us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789762869.885165:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:0.0:1789762869.885875:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.885910:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246546944 00000100:00100000:2.0:1789762869.885915:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246546944 00000100:00100000:2.0:1789762869.885947:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:2.0:1789762869.885954:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+24:11029:x1876702246546944:12345-192.168.203.36@tcp:101:chmod.500 00010000:00010000:2.0:1789762869.885962:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.885969:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59fd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944602 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.885992:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.885999:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886012:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886020:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886025:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886030:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886096:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886102:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886106:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.886137:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x10:0x0]: returning size 0 00000004:00200000:2.0:1789762869.886140:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762869.886149:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886155:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886160:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886172:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886176:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886179:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.886182:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886187:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886193:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.886195:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.886197:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886201:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b59fd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886208:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886212:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886216:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886219:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.886224:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886229:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886233:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x25a23cf0 (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762869.886235:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.886236:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886240:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b59fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886255:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b59fd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944602 expref: 26 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886263:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944602 expref: 25 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.886267:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:2.0:1789762869.886269:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762869.886270:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460a00, rc 0) 00000100:00100000:2.0:1789762869.886295:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:11029:x1876702246546944:12345-192.168.203.36@tcp:101:chmod.500 Request processed in 342us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.886300:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:0.0:1789762869.887224:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.887255:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246547072 00000100:00100000:3.0:1789762869.887260:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246547072 00000100:00100000:0.0:1789762869.887268:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.887293:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246547200 00000100:00100000:3.0:1789762869.887298:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246547200 00000100:00100000:1.0:1789762869.887319:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:2.0:1789762869.887333:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:1.0:1789762869.887334:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246547072:12345-192.168.203.36@tcp:101:chmod.500 00000100:00100000:2.0:1789762869.887349:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2354:x1876702246547200:12345-192.168.203.36@tcp:101:chmod.500 00010000:00010000:1.0:1789762869.887350:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762869.887362:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944609 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.887364:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1789762869.887377:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x0 00010000:00010000:2.0:1789762869.887386:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944610 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.887388:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=172s v=(0 0) 00010000:00010000:1.0:1789762869.887397:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762869.887407:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 9 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762869.887411:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x0 00010000:00010000:1.0:1789762869.887423:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 9 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.887428:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=172s v=(0 0) 00010000:00010000:1.0:1789762869.887432:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b34021f7000, rc 0) 00010000:00010000:2.0:1789762869.887433:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762869.887441:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 10 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.887452:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 10 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.887460:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461a00, rc 0) 00000100:00100000:1.0:1789762869.887466:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246547072:12345-192.168.203.36@tcp:101:chmod.500 Request processed in 138us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.887473:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:2.0:1789762869.887486:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246547200:12345-192.168.203.36@tcp:101:chmod.500 Request processed in 143us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.887493:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:0.0:1789762869.888480:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.888552:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246547456 00000100:00100000:1.0:1789762869.888558:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246547456 00000100:00100000:1.0:1789762869.888587:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:1.0:1789762869.888593:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:11029:x1876702246547456:12345-192.168.203.36@tcp:36:chmod.500 00010000:00010000:1.0:1789762869.888613:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762869.888623:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b59fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944602 expref: 25 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.888633:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:1.0:1789762869.888641:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762869.888652:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.888660:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.888665:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762869.888713:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ff842df reply state 000000003b24bd67 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762869.888722:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762869.888804:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:11029:x1876702246547456:12345-192.168.203.36@tcp:36:chmod.500 Request processed in 208us (323us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789762869.888811:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 114 00010000:00010000:2.0:1789762869.889385:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.889393:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.889398:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.889401:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.889404:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.889417:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.889424:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:2.0:1789762869.889426:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762869.889428:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.889432:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6000/0x5915dfb1c1b59ffb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.889666:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762869.889684:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.889717:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246547584 00000100:00100000:2.0:1789762869.889720:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246547712 00000100:00100000:2.0:1789762869.889723:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246547712 00000100:00100000:3.0:1789762869.889723:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246547584 00000100:00100000:2.0:1789762869.889774:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:0.0:1789762869.889783:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:2.0:1789762869.889788:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246547712:12345-192.168.203.36@tcp:2:chmod.500 00000100:00100000:0.0:1789762869.889796:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246547584:12345-192.168.203.36@tcp:2:chmod.500 00002000:00010000:2.0:1789762869.889859:0:6912:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762869.889863:0:6912:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789762870 -> 1789762870 00002000:00010000:2.0:1789762869.889865:0:6912:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1789762870 -> 1789762870 00002000:00010000:2.0:1789762869.889867:0:6912:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789762870 -> 1789762870 00002000:00010000:0.0:1789762869.889869:0:7959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762869.889870:0:6912:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1789762869.889876:0:7959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789762870 -> 1789762870 00002000:00010000:0.0:1789762869.889879:0:7959:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789762870 -> 1789762870 00002000:00010000:0.0:1789762869.889881:0:7959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789762870 -> 1789762870 00002000:00010000:0.0:1789762869.889883:0:7959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789762869.889905:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2356:x1876702246547712:12345-192.168.203.36@tcp:2:chmod.500 Request processed in 123us (218us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789762869.889909:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246547584:12345-192.168.203.36@tcp:2:chmod.500 Request processed in 116us (241us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789762869.889916:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:0.0:1789762869.889927:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:0.0:1789762869.907342:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.907386:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246547968 00000100:00100000:2.0:1789762869.907400:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246547968 00000100:00100000:2.0:1789762869.907436:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:2.0:1789762869.907447:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:11033:x1876702246547968:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762869.907474:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.907477:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762869.907494:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7400/0x5915dfb1c1b59f99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445e6 expref: 25 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907507:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.907510:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762869.907517:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a002 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944617 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907589:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907598:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907603:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907613:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907618:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907622:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907651:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907664:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907670:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762869.907676:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 0 00010000:00010000:2.0:1789762869.907718:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907723:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907727:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907731:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.907734:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907739:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907744:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762869.907746:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.907774:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907782:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a009 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907792:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907805:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907813:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907818:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.907822:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907827:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907834:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x3950208a (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762869.907835:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.907837:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907842:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a010 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907867:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a002 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944617 expref: 27 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907875:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944617 expref: 26 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.907880:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:2.0:1789762869.907882:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762869.907888:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460600, rc 0) 00000100:00100000:2.0:1789762869.907922:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:11033:x1876702246547968:12345-192.168.203.36@tcp:101:dd.500 Request processed in 478us (585us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789762869.907927:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:1.0:1789762869.908976:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762869.909024:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246548096 00000100:00100000:0.0:1789762869.909029:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246548096 00000100:00100000:0.0:1789762869.909058:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:0.0:1789762869.909064:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:11033:x1876702246548096:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:0.0:1789762869.909073:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762869.909081:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b5a025 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894461e expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762869.909097:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5a02c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762869.909104:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5a02c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762869.909110:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5a02c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762869.909195:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ee800/0x5915dfb1c1b5a025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894461e expref: 28 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762869.909210:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5a02c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894461e expref: 27 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762869.909218:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:0.0:1789762869.909222:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789762869.909224:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13efc00, rc 0) 00000100:00100000:0.0:1789762869.909256:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:11033:x1876702246548096:12345-192.168.203.36@tcp:101:dd.500 Request processed in 192us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762869.909261:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:0.0:1789762869.910066:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.910102:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246548352 00000100:00100000:2.0:1789762869.910108:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246548352 00000100:00100000:2.0:1789762869.910153:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:2.0:1789762869.910164:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:11033:x1876702246548352:12345-192.168.203.36@tcp:36:dd.500 00010000:00010000:2.0:1789762869.910184:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762869.910195:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944617 expref: 27 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910205:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:2.0:1789762869.910208:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762869.910275:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910283:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910288:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762869.910315:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967372 00000004:00010000:2.0:1789762869.910328:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051c6f647 reply state 00000000de53d264 transno 4294967373 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.910334:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762869.910376:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:11033:x1876702246548352:12345-192.168.203.36@tcp:36:dd.500 Request processed in 213us (312us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789762869.910391:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 117 00000020:00080000:2.0:1789762869.910395:0:5926:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789762869.910881:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910888:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910892:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910896:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762869.910898:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910903:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910909:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:2.0:1789762869.910911:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762869.910913:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.910917:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a033 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762869.911035:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.911064:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246548480 00000100:00100000:2.0:1789762869.911071:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246548480 00000100:00100000:2.0:1789762869.911101:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:2.0:1789762869.911109:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11033:x1876702246548480:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762869.911143:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.911153:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a03a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944625 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.911174:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 12 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.911180:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762869.911183:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762869.911186:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a03a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944625 expref: 12 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.911208:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 12 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.911218:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 12 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.911229:0:6911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254910080:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762869.911286:0:6911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c2f8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762869.911972:0:6911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1876702254910080:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762869.911987:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a03a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944625 expref: 12 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.911996:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460a00, rc 0) 00000100:00100000:2.0:1789762869.912025:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:11033:x1876702246548480:12345-192.168.203.36@tcp:101:dd.500 Request processed in 918us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.912031:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:1.0:1789762869.912262:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.912297:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246548608 00000100:00100000:2.0:1789762869.912301:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246548608 00010000:00010000:2.0:1789762869.912316:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 12 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.912337:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:2.0:1789762869.912342:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246548608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762869.912350:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762869.912354:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 12 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.912362:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 12 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.912372:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b59fbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445f4 expref: 12 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.912380:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762869.912383:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762869.912387:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a03a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944625 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.912393:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a03a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944625 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.912414:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a03a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944625 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.912421:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254910208:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762869.912455:0:5910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c2f8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762869.913314:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254910208:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762869.913324:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762869.913352:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2353:x1876702246548608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1008us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.913361:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:3.0:1789762869.913416:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.913444:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246548736 00000100:00100000:2.0:1789762869.913449:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246548736 00000100:00100000:2.0:1789762869.913487:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:2.0:1789762869.913497:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:11033:x1876702246548736:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762869.913506:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762869.913515:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e726d47/0x5915dfb1c1b5a041 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894462c expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.913534:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 11 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.913543:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762869.913547:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762869.913552:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e726d47/0x5915dfb1c1b5a041 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894462c expref: 11 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.913578:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 11 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.913587:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 11 pid: 6912 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762869.913595:0:6909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1876702254910336:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762869.913625:0:6909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c2f8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762869.914220:0:6909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1876702254910336:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762869.914234:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e726d47/0x5915dfb1c1b5a041 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894462c expref: 11 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762869.914242:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460c00, rc 0) 00000100:00100000:2.0:1789762869.914267:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11033:x1876702246548736:12345-192.168.203.36@tcp:101:dd.500 Request processed in 773us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762869.914275:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:3.0:1789762869.914399:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762869.914445:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246548864 00000100:00100000:1.0:1789762869.914452:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246548864 00010000:00010000:1.0:1789762869.914475:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 11 pid: 6912 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762869.914507:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1789762869.914518:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2354:x1876702246548864:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762869.914528:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762869.914534:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 11 pid: 6912 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.914570:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 11 pid: 6912 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.914587:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007006d81e/0x5915dfb1c1b59fc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445fb expref: 11 pid: 6912 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.914602:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762869.914606:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762869.914612:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e726d47/0x5915dfb1c1b5a041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894462c expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.914622:0:5911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e726d47/0x5915dfb1c1b5a041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894462c expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762869.914650:0:5911:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e726d47/0x5915dfb1c1b5a041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894462c expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762869.914662:0:5911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5911:1876702254910464:192.168.203.36@tcp:105: 00000100:00100000:1.0:1789762869.914705:0:5911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fc418540 going to sleep for 11 seconds 00000100:00100000:1.0:1789762869.915499:0:5911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5911:1876702254910464:192.168.203.36@tcp:105: 00010000:00010000:1.0:1789762869.915513:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762869.915543:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246548864:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1028us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762869.915563:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:3.0:1789762869.915793:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762869.915829:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762869.915843:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246548992 00000100:00100000:0.0:1789762869.915848:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246548992 00000100:00100000:1.0:1789762869.915868:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246549120 00000100:00100000:1.0:1789762869.915875:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246549120 00002000:00010000:0.0:1789762869.915878:0:6916:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789762869.915887:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4d76300 with x1876702246548992 ext(0->18446744073709551615) 00002000:00010000:1.0:1789762869.915893:0:12139:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00010000:0.0:1789762869.915895:0:6916:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4d76300. 00002000:00100000:1.0:1789762869.915900:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4d77800 with x1876702246549120 ext(0->18446744073709551615) 00002000:00010000:1.0:1789762869.915907:0:12139:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4d77800. 00000100:00100000:0.0:1789762869.915916:0:6916:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 3 deadline 0 time 172353158593 state 0x0 ref 1 00000100:00100000:1.0:1789762869.915921:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 3 deadline 172553158593 time 172353158593 state 0x1 ref 2 00000100:00100000:0.0:1789762869.915934:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 3 deadline 172553158593 time 172353158593 state 0x1 ref 2 00000100:00100000:1.0:1789762869.915968:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 2 deadline 172553212047 time 172353212047 state 0x1 ref 2 00000100:00100000:3.0:1789762869.915980:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 172553212047 time 172353224195 state 0x0 ref 2 00000100:00100000:1.0:1789762869.915982:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246549120:12345-192.168.203.36@tcp:10:dd.500 00000100:00100000:3.0:1789762869.916005:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2354:x1876702246548992:12345-192.168.203.36@tcp:10:dd.500 00002000:00010000:1.0:1789762869.916207:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789762869.916209:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789762869.916211:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789762870 -> 1789762870 00002000:00010000:3.0:1789762869.916215:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789762870 -> 1789762870 00002000:00010000:1.0:1789762869.916216:0:12139:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789762870 -> 1789762870 00002000:00010000:3.0:1789762869.916220:0:12137:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789762870 -> 1789762870 00002000:00010000:1.0:1789762869.916221:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789762870 -> 1789762870 00002000:00010000:3.0:1789762869.916225:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789762870 -> 1789762870 00002000:00010000:1.0:1789762869.916226:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1789762869.916231:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789762869.916260:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2353:x1876702246549120:12345-192.168.203.36@tcp:10:dd.500 Request processed in 281us (430us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789762869.916266:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2354:x1876702246548992:12345-192.168.203.36@tcp:10:dd.500 Request processed in 262us (472us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789762869.916269:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 0 00002000:00010000:1.0:1789762869.916273:0:12139:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789762869.916278:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4d77800 with x1876702246549120 ext(0->18446744073709551615) 00002000:00010000:1.0:1789762869.916285:0:12139:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4d77800. 00000100:00100000:3.0:1789762869.916292:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:3.0:1789762869.916299:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 172553212047 time 172353224195 state 0x2 ref 0 00002000:00010000:3.0:1789762869.916306:0:12137:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1789762869.916310:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4d76300 with x1876702246548992 ext(0->18446744073709551615) 00002000:00010000:3.0:1789762869.916316:0:12137:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4d76300. 00000100:00100000:0.0:1789762869.967341:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762869.967412:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246549248 00000100:00100000:2.0:1789762869.967429:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246549248 00002000:00100000:2.0:1789762869.967505:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4194303) req@ffff9b33f769bb80 x1876702246549248/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:650/0 lens 488/0 e 0 to 0 dl 1789762880 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762869.967558:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769bb80 with x1876702246549248 ext(0->4194303) 00002000:00010000:2.0:1789762869.967564:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f769bb80 00000100:00100000:2.0:1789762869.967577:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 172553212047 time 172353224195 state 0x0 ref 1 00000100:00100000:2.0:1789762869.967599:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 172553224195 time 172353224195 state 0x1 ref 1 00000100:00100000:2.0:1789762869.967657:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172553224195 time 172404901828 state 0x0 ref 1 00000100:00100000:2.0:1789762869.967689:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2355:x1876702246549248:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762869.986973:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2355:x1876702246549248:12345-192.168.203.36@tcp:4:dd.500 Request processed in 19296us (19633us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789762869.986983:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:2.0:1789762869.986989:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172553224195 time 172404901828 state 0x2 ref 0 00002000:00100000:2.0:1789762869.987001:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4194303) req@ffff9b33f769bb80 x1876702246549248/t4294967420(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:650/0 lens 488/448 e 0 to 0 dl 1789762880 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762869.987008:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769bb80 with x1876702246549248 ext(0->4194303) 00002000:00010000:2.0:1789762869.987013:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f769bb80 00000100:00100000:3.0:1789762870.014446:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.014537:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246549376 00000100:00100000:1.0:1789762870.014547:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246549376 00002000:00100000:1.0:1789762870.014590:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->4194303) req@ffff9b33fee3f480 x1876702246549376/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762870.014616:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33fee3f480 with x1876702246549376 ext(0->4194303) 00002000:00010000:1.0:1789762870.014621:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33fee3f480 00000100:00100000:1.0:1789762870.014633:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172553224195 time 172404901828 state 0x0 ref 1 00000100:00100000:1.0:1789762870.014643:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172604901828 time 172404901828 state 0x1 ref 1 00000100:00100000:0.0:1789762870.046304:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.046368:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246549504 00000100:00100000:2.0:1789762870.046377:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246549504 00002000:00100000:2.0:1789762870.046418:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x5:0x0] (4194304->8388607) req@ffff9b33f7698380 x1876702246549504/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762870.046427:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7698380 with x1876702246549504 ext(4194304->8388607) 00002000:00010000:2.0:1789762870.046433:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7698380 00000100:00100000:2.0:1789762870.046449:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172604901828 time 172404901828 state 0x1 ref 2 00000100:00100000:0.0:1789762870.080668:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762870.080720:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246549632 00000100:00100000:3.0:1789762870.080731:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246549632 00002000:00100000:3.0:1789762870.080793:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (4194304->8364031) req@ffff9b33f769aa00 x1876702246549632/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762870.080806:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769aa00 with x1876702246549632 ext(4194304->8364031) 00002000:00010000:3.0:1789762870.080811:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f769aa00 00000100:00100000:3.0:1789762870.080827:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172604901828 time 172404901828 state 0x1 ref 3 00010000:00010000:2.0:1789762870.138888:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762870.167789:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172805028710 time 172605028710 state 0x1 ref 3 00000100:00100000:2.0:1789762870.167813:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fee3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2356:x1876702246549376:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762870.180258:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fee3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2356:x1876702246549376:12345-192.168.203.36@tcp:4:dd.500 Request processed in 12451us (165831us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789762870.180268:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 3 00002000:00100000:2.0:1789762870.180280:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->4194303) req@ffff9b33fee3f480 x1876702246549376/t4294967319(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762870.180289:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33fee3f480 with x1876702246549376 ext(0->4194303) 00002000:00010000:2.0:1789762870.180295:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33fee3f480 00000100:00100000:1.0:1789762870.182159:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.182214:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246549888 00000100:00100000:2.0:1789762870.182222:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246549888 00000100:00100000:2.0:1789762870.182261:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:2.0:1789762870.182268:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:11033:x1876702246549888:12345-192.168.203.36@tcp:35:dd.500 00000100:00100000:2.0:1789762870.182436:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:11033:x1876702246549888:12345-192.168.203.36@tcp:35:dd.500 Request processed in 168us (278us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789762870.182443:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1789762870.212727:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.212802:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246550016 00000100:00100000:1.0:1789762870.212811:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246550016 00002000:00100000:1.0:1789762870.212848:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (8364032->8388607) req@ffff9b33f7698000 x1876702246550016/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762870.212857:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7698000 with x1876702246550016 ext(8364032->8388607) 00002000:00010000:1.0:1789762870.212862:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f7698000 00000100:00100000:1.0:1789762870.212875:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 172805028710 time 172605028710 state 0x1 ref 3 00000100:00100000:1.0:1789762870.217153:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762870.217204:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246550272 00000100:00100000:3.0:1789762870.217210:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246550272 00000100:00100000:3.0:1789762870.217292:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:3.0:1789762870.217304:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:11044:x1876702246550272:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762870.217323:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762870.217341:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a048 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944633 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217458:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217473:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217492:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217507:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217515:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217523:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217578:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4400/0x5915dfb1c1b5a05d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217587:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4400/0x5915dfb1c1b5a05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217595:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4400/0x5915dfb1c1b5a05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762870.217604:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x10:0x0]: returning size 0 00010000:00010000:3.0:1789762870.217672:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217680:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217687:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217694:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762870.217706:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217715:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217727:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:3.0:1789762870.217731:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762870.217734:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217742:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a04f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217783:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217791:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217800:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217807:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762870.217810:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217817:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217825:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x25a23cf0 (ffff9b33e2f49c00) 00010000:00010000:3.0:1789762870.217828:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762870.217837:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.217844:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.217965:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a048 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944633 expref: 32 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.217981:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4400/0x5915dfb1c1b5a05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944633 expref: 31 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.217987:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:2.0:1789762870.217990:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762870.217992:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de4400, rc 0) 00000100:00100000:2.0:1789762870.218036:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:11044:x1876702246550272:12345-192.168.203.36@tcp:101:dd.0 Request processed in 735us (885us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789762870.218051:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:0.0:1789762870.223915:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.223954:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246550400 00000100:00100000:2.0:1789762870.223959:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246550400 00000100:00100000:2.0:1789762870.223990:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:2.0:1789762870.223996:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:11045:x1876702246550400:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762870.224004:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762870.224012:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a06b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894463a expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.224033:0:7959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 16 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.224050:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.224054:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.224059:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a06b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894463a expref: 16 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.224095:0:7959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 16 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.224110:0:7959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 16 pid: 6909 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.224137:0:7959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7959:1876702254910592:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762870.224223:0:7959:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c2f8a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762870.224405:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762870.224435:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.224469:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246550528 00000100:00100000:2.0:1789762870.224476:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246550528 00000100:00100000:1.0:1789762870.224485:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246550656 00000100:00100000:1.0:1789762870.224491:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246550656 00000100:00100000:2.0:1789762870.224514:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:2.0:1789762870.224522:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:11044:x1876702246550528:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762870.224531:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789762870.224535:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 69 00010000:00010000:2.0:1789762870.224540:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a072 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944641 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762870.224547:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:11046:x1876702246550656:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762870.224560:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762870.224568:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762870.224570:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2de00a/0x5915dfb1c1b5a079 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944648 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.224575:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.224589:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a072 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944641 expref: 20 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.224601:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762870.224606:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762870.224617:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2de00a/0x5915dfb1c1b5a079 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944648 expref: 20 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.224630:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d2de00a/0x5915dfb1c1b5a079 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944648 expref: 20 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.224631:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a072 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944641 expref: 20 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.224650:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da6000, rc 0) 00010000:00010000:2.0:1789762870.224652:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460600, rc 0) 00000100:00100000:1.0:1789762870.224684:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:11046:x1876702246550656:12345-192.168.203.36@tcp:101:dd.0 Request processed in 140us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.224685:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:11044:x1876702246550528:12345-192.168.203.36@tcp:101:dd.0 Request processed in 162us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.224703:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:1.0:1789762870.224710:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:2.0:1789762870.225041:0:7959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7959:1876702254910592:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762870.225056:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a06b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894463a expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225065:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460200, rc 0) 00000100:00100000:2.0:1789762870.225089:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:11045:x1876702246550400:12345-192.168.203.36@tcp:101:dd.0 Request processed in 1094us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.225100:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1789762870.225359:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.225402:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246550784 00000100:00100000:2.0:1789762870.225407:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246550784 00010000:00010000:2.0:1789762870.225422:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 18 pid: 6909 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.225452:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:2.0:1789762870.225461:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:2353:x1876702246550784:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762870.225473:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762870.225493:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 18 pid: 6909 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225502:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 18 pid: 6909 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225514:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6962680/0x5915dfb1c1b59fed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944609 expref: 18 pid: 6909 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225523:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.225526:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.225531:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a06b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894463a expref: 17 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225537:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a06b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894463a expref: 17 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225557:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.225559:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.225566:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944641 expref: 17 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225574:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944641 expref: 17 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225583:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.225586:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.225592:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d2de00a/0x5915dfb1c1b5a079 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944648 expref: 17 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225601:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2de00a/0x5915dfb1c1b5a079 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944648 expref: 17 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.225619:0:5909:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006d2de00a/0x5915dfb1c1b5a079 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944648 expref: 17 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.225626:0:5909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254910720:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762870.225664:0:5909:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944641 expref: 17 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.225672:0:5909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254910848:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762870.225706:0:5909:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a06b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894463a expref: 17 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.225715:0:5909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254910976:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762870.225728:0:5909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c2f8a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762870.227550:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.227565:0:5909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254910720:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762870.227578:0:5909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254910848:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762870.227587:0:5909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1876702254910976:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762870.227601:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762870.227614:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246550912 00000100:00100000:3.0:1789762870.227620:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246550912 00000100:00100000:2.0:1789762870.227632:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:2353:x1876702246550784:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2171us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.227640:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:3.0:1789762870.227670:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:3.0:1789762870.227683:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:11046:x1876702246550912:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762870.227698:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762870.227711:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894464f expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.227735:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.227815:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.227827:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.227911:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894464f expref: 33 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.227928:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894464f expref: 32 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.227938:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:3.0:1789762870.227947:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762870.227950:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de4000, rc 0) 00000100:00100000:3.0:1789762870.227985:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11046:x1876702246550912:12345-192.168.203.36@tcp:101:dd.0 Request processed in 306us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762870.227993:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:0.0:1789762870.234932:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762870.234974:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246551040 00000100:00100000:3.0:1789762870.234981:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246551040 00000100:00100000:3.0:1789762870.235023:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:3.0:1789762870.235035:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:11048:x1876702246551040:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762870.235047:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762870.235059:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a08e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944656 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.235084:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 16 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.235094:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762870.235098:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762870.235104:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a08e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944656 expref: 16 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.235149:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 16 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.235165:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 16 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762870.235196:0:6909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1419180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1876702254911104:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762870.235279:0:6909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f47b5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789762870.236189:0:6909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1419180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1876702254911104:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762870.236274:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a08e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944656 expref: 16 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.236290:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5e00, rc 0) 00000100:00100000:3.0:1789762870.236331:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:11048:x1876702246551040:12345-192.168.203.36@tcp:101:dd.0 Request processed in 1298us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762870.236342:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:0.0:1789762870.236348:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.236396:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246551168 00000100:00100000:2.0:1789762870.236402:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246551168 00010000:00010000:2.0:1789762870.236423:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 16 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.236454:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:2.0:1789762870.236460:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2354:x1876702246551168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762870.236468:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762870.236480:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 16 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.236491:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 16 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.236513:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b59ff4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944610 expref: 16 pid: 6911 timeout: 272 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.236522:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.236525:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.236531:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a08e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944656 expref: 15 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.236538:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944656 expref: 15 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.236555:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944656 expref: 15 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.236570:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254911232:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762870.236609:0:5910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c2f8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789762870.237376:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254911232:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762870.237385:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762870.237409:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2354:x1876702246551168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 950us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.237415:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:2.0:1789762870.367862:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173005098393 time 172805098393 state 0x1 ref 3 00000100:00100000:2.0:1789762870.367892:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2355:x1876702246549504:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762870.379988:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2355:x1876702246549504:12345-192.168.203.36@tcp:4:dd.500 Request processed in 12105us (333685us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789762870.379999:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 4 00002000:00100000:2.0:1789762870.380009:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x5:0x0] (4194304->8388607) req@ffff9b33f7698380 x1876702246549504/t4294967421(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762870.380017:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7698380 with x1876702246549504 ext(4194304->8388607) 00002000:00010000:2.0:1789762870.380023:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7698380 00000100:00100000:3.0:1789762870.441241:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.441298:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246551296 00000100:00100000:1.0:1789762870.441308:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246551296 00002000:00100000:1.0:1789762870.441349:0:12139:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff9b32c1419180 x1876702246551296/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762870.441358:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c1419180 with x1876702246551296 ext(4194304->8388607) 00002000:00010000:1.0:1789762870.441363:0:12139:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c1419180 00000100:00100000:1.0:1789762870.441379:0:12139:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 172878623429 state 0x0 ref 1 00000100:00100000:1.0:1789762870.441393:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 3 deadline 172878723429 time 172878623429 state 0x1 ref 1 00000100:00100000:0.0:1789762870.441540:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172878723429 time 172878782679 state 0x0 ref 1 00000100:00100000:0.0:1789762870.441554:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:2356:x1876702246551296:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762870.452364:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.452407:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246551424 00000100:00100000:2.0:1789762870.452416:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246551424 00002000:00100000:2.0:1789762870.452453:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4194304->8388607) req@ffff9b33f769b800 x1876702246551424/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762870.452462:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769b800 with x1876702246551424 ext(4194304->8388607) 00002000:00010000:2.0:1789762870.452466:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f769b800 00000100:00100000:2.0:1789762870.452480:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172878882679 time 172878782679 state 0x1 ref 2 00000100:00100000:2.0:1789762870.452512:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172878882679 time 172889758090 state 0x0 ref 2 00000100:00100000:2.0:1789762870.452521:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2355:x1876702246551424:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762870.455256:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762870.455349:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246551552 00000100:00100000:3.0:1789762870.455356:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246551552 00002000:00100000:3.0:1789762870.455395:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff9b33f7699880 x1876702246551552/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762870.455406:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7699880 with x1876702246551552 ext(0->4194303) 00002000:00010000:3.0:1789762870.455411:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7699880 00000100:00100000:3.0:1789762870.455450:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172889858090 time 172889758090 state 0x1 ref 3 00000100:00100000:0.0:1789762870.455491:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172889858090 time 172892735727 state 0x0 ref 3 00000100:00100000:0.0:1789762870.455505:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:2356:x1876702246551552:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:1.0:1789762870.458362:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.458397:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246551680 00000100:00100000:1.0:1789762870.458412:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246551680 00002000:00100000:1.0:1789762870.458437:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff9b32c4d66a00 x1876702246551680/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 504/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762870.458449:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4d66a00 with x1876702246551680 ext(0->4194303) 00002000:00010000:1.0:1789762870.458462:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4d66a00 00000100:00100000:1.0:1789762870.458520:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172892835727 time 172892735727 state 0x1 ref 4 00000100:00100000:1.0:1789762870.458541:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172892835727 time 172895787558 state 0x0 ref 4 00000100:00100000:1.0:1789762870.458555:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2356:x1876702246551680:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762870.460315:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2356:x1876702246551296:12345-192.168.203.36@tcp:4:dd.0 Request processed in 18762us (19080us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789762870.460324:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 7 00002000:00100000:0.0:1789762870.460332:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (4194304->8388607) req@ffff9b32c1419180 x1876702246551296/t4294967320(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762870.460340:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c1419180 with x1876702246551296 ext(4194304->8388607) 00002000:00010000:0.0:1789762870.460344:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c1419180 00000100:00100000:0.0:1789762870.465888:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.465944:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246551936 00000100:00100000:1.0:1789762870.465953:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246551936 00000100:00100000:1.0:1789762870.466006:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:1.0:1789762870.466016:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11045:x1876702246551936:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:1.0:1789762870.466268:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11045:x1876702246551936:12345-192.168.203.36@tcp:35:dd.0 Request processed in 253us (382us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789762870.466275:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:0.0:1789762870.468902:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2355:x1876702246551424:12345-192.168.203.36@tcp:4:dd.0 Request processed in 16379us (16543us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789762870.468920:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 8 00002000:00100000:0.0:1789762870.468930:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (4194304->8388607) req@ffff9b33f769b800 x1876702246551424/t4294967422(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762870.468939:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769b800 with x1876702246551424 ext(4194304->8388607) 00002000:00010000:0.0:1789762870.468944:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f769b800 00000100:00100000:1.0:1789762870.472275:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2356:x1876702246551552:12345-192.168.203.36@tcp:4:dd.0 Request processed in 16768us (17016us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789762870.472285:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 9 00002000:00100000:1.0:1789762870.472303:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x6:0x0] (0->4194303) req@ffff9b33f7699880 x1876702246551552/t4294967423(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762870.472312:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7699880 with x1876702246551552 ext(0->4194303) 00002000:00010000:1.0:1789762870.472316:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33f7699880 00000100:00100000:1.0:1789762870.476888:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2356:x1876702246551680:12345-192.168.203.36@tcp:4:dd.0 Request processed in 18334us (18524us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789762870.476897:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1789762870.476903:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172892835727 time 172895787558 state 0x2 ref 0 00002000:00100000:1.0:1789762870.476913:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4194303) req@ffff9b32c4d66a00 x1876702246551680/t4294967321(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 504/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762870.476931:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4d66a00 with x1876702246551680 ext(0->4194303) 00002000:00010000:1.0:1789762870.476942:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4d66a00 00000100:00100000:3.0:1789762870.567973:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173205209145 time 173005209145 state 0x1 ref 2 00000100:00100000:3.0:1789762870.568006:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2353:x1876702246549632:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:1.0:1789762870.581504:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+22:2353:x1876702246549632:12345-192.168.203.36@tcp:4:dd.500 Request processed in 13509us (500838us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789762870.581516:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 5 00002000:00100000:1.0:1789762870.581527:0:12139:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (4194304->8364031) req@ffff9b33f769aa00 x1876702246549632/t4294967322(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762870.581536:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769aa00 with x1876702246549632 ext(4194304->8364031) 00002000:00010000:1.0:1789762870.581541:0:12139:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f769aa00 00000100:00100000:3.0:1789762870.768146:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173205209145 time 173205382745 state 0x0 ref 1 00000100:00100000:3.0:1789762870.768186:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2353:x1876702246550016:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:1.0:1789762870.769944:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:2353:x1876702246550016:12345-192.168.203.36@tcp:4:dd.500 Request processed in 1766us (557221us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789762870.769953:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1789762870.769959:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173205209145 time 173205382745 state 0x2 ref 0 00002000:00100000:1.0:1789762870.769969:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (8364032->8388607) req@ffff9b33f7698000 x1876702246550016/t4294967323(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762870.769977:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f7698000 with x1876702246550016 ext(8364032->8388607) 00002000:00010000:1.0:1789762870.769983:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f7698000 00000100:00100000:0.0:1789762870.803427:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762870.803504:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246552064 00000100:00100000:3.0:1789762870.803514:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246552064 00002000:00100000:3.0:1789762870.803554:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1949696->2097151) req@ffff9b33f769b480 x1876702246552064/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762870.803563:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769b480 with x1876702246552064 ext(1949696->2097151) 00002000:00010000:3.0:1789762870.803568:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f769b480 00000100:00100000:3.0:1789762870.803579:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172892835727 time 172895787558 state 0x0 ref 1 00000100:00100000:3.0:1789762870.803588:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172895887558 time 172895787558 state 0x1 ref 1 00000100:00100000:3.0:1789762870.803609:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172895887558 time 173240856010 state 0x0 ref 1 00000100:00100000:3.0:1789762870.803619:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:2353:x1876702246552064:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:3.0:1789762870.807215:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:2353:x1876702246552064:12345-192.168.203.36@tcp:4:dd.0 Request processed in 3595us (3792us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789762870.807223:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1789762870.807227:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172895887558 time 173240856010 state 0x2 ref 0 00002000:00100000:3.0:1789762870.807235:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (1949696->2097151) req@ffff9b33f769b480 x1876702246552064/t4294967324(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/448 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762870.807242:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33f769b480 with x1876702246552064 ext(1949696->2097151) 00002000:00010000:3.0:1789762870.807246:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33f769b480 00000100:00100000:2.0:1789762870.816396:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.816452:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246552192 00000100:00100000:1.0:1789762870.816458:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246552192 00000100:00100000:1.0:1789762870.816496:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:1.0:1789762870.816502:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:10429:x1876702246552192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762870.816511:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:1.0:1789762870.816530:0:5911:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762870.816533:0:5911:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:1.0:1789762870.816552:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a03a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944625 expref: 20 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762870.816573:0:5911:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762870.816575:0:5911:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:1.0:1789762870.816580:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a08e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944656 expref: 19 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.816590:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762870.816626:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:10429:x1876702246552192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762870.816631:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:0.0:1789762870.818886:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.818924:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246552320 00000100:00100000:2.0:1789762870.818929:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246552320 00000100:00100000:2.0:1789762870.818961:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:2.0:1789762870.818969:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:5431:x1876702246552320:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762870.818977:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00002000:00010000:2.0:1789762870.818991:0:5909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789762870.818994:0:5909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:2.0:1789762870.819005:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e726d47/0x5915dfb1c1b5a041 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894462c expref: 25 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762870.819022:0:5909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789762870.819024:0:5909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:2.0:1789762870.819030:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a06b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894463a expref: 24 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.819038:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a072 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944641 expref: 23 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.819045:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2de00a/0x5915dfb1c1b5a079 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944648 expref: 22 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.819053:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762870.819079:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:5431:x1876702246552320:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 112us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.819084:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:0.0:1789762870.862408:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.862469:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246552576 00000100:00100000:1.0:1789762870.862478:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246552576 00000100:00100000:1.0:1789762870.862524:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:1.0:1789762870.862532:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11080:x1876702246552576:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762870.862551:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762870.862576:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894465d expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862636:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862648:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862657:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862679:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862684:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862689:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862806:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a0aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862812:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a0aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862817:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a0aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762870.862824:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 16777216 00010000:00010000:1.0:1789762870.862887:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862895:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862903:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862910:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762870.862915:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862933:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862943:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:1.0:1789762870.862945:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762870.862948:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862953:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a09c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862963:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862966:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862971:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862974:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762870.862976:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862980:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862984:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x3950208a (ffff9b33f4535800) 00010000:00010000:1.0:1789762870.862985:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762870.862987:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.862997:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.863027:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894465d expref: 36 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.863036:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a0aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894465d expref: 35 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.863041:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:1.0:1789762870.863043:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762870.863045:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7000, rc 0) 00000100:00100000:1.0:1789762870.863096:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:11080:x1876702246552576:12345-192.168.203.36@tcp:101:dd.0 Request processed in 566us (696us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789762870.863101:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:0.0:1789762870.864647:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.864696:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246552704 00000100:00100000:2.0:1789762870.864702:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246552704 00000100:00100000:0.0:1789762870.864721:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.864747:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246552832 00000100:00100000:2.0:1789762870.864777:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246552832 00000100:00100000:1.0:1789762870.864787:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:1.0:1789762870.864800:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:11081:x1876702246552704:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762870.864809:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789762870.864811:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00010000:00010000:1.0:1789762870.864822:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944664 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.864826:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:11080:x1876702246552832:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762870.864843:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1789762870.864852:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x4000 00010000:00010000:2.0:1789762870.864860:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894466b expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.864871:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=173s v=(0 0) 00010000:00010000:1.0:1789762870.864878:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762870.864888:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 21 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.864914:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.864918:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762870.864924:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 21 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.864941:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 21 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.864942:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 21 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.864962:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460600, rc 0) 00010000:00010000:1.0:1789762870.864965:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7a00, rc 0) 00000100:00100000:1.0:1789762870.864997:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:11081:x1876702246552704:12345-192.168.203.36@tcp:101:dd.0 Request processed in 198us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.864999:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:11080:x1876702246552832:12345-192.168.203.36@tcp:101:dd.0 Request processed in 173us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762870.865005:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:2.0:1789762870.865016:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:0.0:1789762870.870045:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.870101:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246552960 00000100:00100000:2.0:1789762870.870105:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246552960 00002000:00100000:2.0:1789762870.870137:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->1048575) req@ffff9b32c3053100 x1876702246552960/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1789762881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762870.870146:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c3053100 with x1876702246552960 ext(0->1048575) 00002000:00010000:2.0:1789762870.870149:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c3053100 00000100:00100000:2.0:1789762870.870159:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 172895887558 time 173240856010 state 0x0 ref 1 00000100:00100000:2.0:1789762870.870166:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 173240956010 time 173240856010 state 0x1 ref 1 00000100:00100000:2.0:1789762870.870185:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 173240956010 time 173307431751 state 0x0 ref 1 00000100:00100000:2.0:1789762870.870192:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2354:x1876702246552960:12345-192.168.203.36@tcp:3:dd.0 00000100:00100000:2.0:1789762870.874422:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2354:x1876702246552960:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4226us (4374us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762870.874432:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1789762870.874438:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 173240956010 time 173307431751 state 0x2 ref 0 00002000:00100000:2.0:1789762870.874450:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->1048575) req@ffff9b32c3053100 x1876702246552960/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:651/0 lens 488/440 e 0 to 0 dl 1789762881 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762870.874460:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c3053100 with x1876702246552960 ext(0->1048575) 00002000:00010000:2.0:1789762870.874464:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c3053100 00000100:00100000:0.0:1789762870.915793:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.915846:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246553216 00000100:00100000:2.0:1789762870.915855:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246553216 00000100:00100000:2.0:1789762870.915903:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:2.0:1789762870.915915:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:11094:x1876702246553216:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762870.916132:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:11094:x1876702246553216:12345-192.168.203.36@tcp:35:dd.0 Request processed in 220us (344us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789762870.916138:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1789762870.926223:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.926272:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246553344 00000100:00100000:2.0:1789762870.926276:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246553344 00000100:00100000:2.0:1789762870.926307:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:2.0:1789762870.926314:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:11096:x1876702246553344:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:2.0:1789762870.926329:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762870.926347:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944672 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.926396:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.926420:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.926438:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762870.926461:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1789762870.926464:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762870.926475:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.926493:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944672 expref: 38 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.926512:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944672 expref: 37 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.926518:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762870.926521:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762870.926524:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460c00, rc 0) 00000100:00100000:2.0:1789762870.926559:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11096:x1876702246553344:12345-192.168.203.36@tcp:101:rm.0 Request processed in 245us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762870.926567:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:3.0:1789762870.928615:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.928700:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246553472 00000100:00100000:1.0:1789762870.928707:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246553472 00000100:00100000:1.0:1789762870.928746:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:1.0:1789762870.928779:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11096:x1876702246553472:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:1.0:1789762870.930507:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11096:x1876702246553472:12345-192.168.203.36@tcp:37:rm.0 Request processed in 1730us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762870.930513:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:0.0:1789762870.931961:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.932011:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246553600 00000100:00100000:1.0:1789762870.932016:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246553600 00000100:00100000:1.0:1789762870.932046:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:1.0:1789762870.932052:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11096:x1876702246553600:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:1.0:1789762870.932080:0:5924:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7384293376 00000100:00100000:1.0:1789762870.932129:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11096:x1876702246553600:12345-192.168.203.36@tcp:41:rm.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762870.932135:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:3.0:1789762870.932981:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.933023:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246553856 00000100:00100000:2.0:1789762870.933028:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246553856 00000100:00100000:2.0:1789762870.933057:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:2.0:1789762870.933063:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11096:x1876702246553856:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762870.933088:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789762870.933125:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a0aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894465d expref: 37 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933141:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13efc00/0x5915dfb1c1b5a02c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894461e expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933151:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f6400/0x5915dfb1c1b59f3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445ca expref: 35 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933158:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:2.0:1789762870.933166:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a0cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944672 expref: 34 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933172:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762870.933174:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762870.933184:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933190:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933195:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933205:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933210:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933214:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933273:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933279:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933283:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762870.933439:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789762870.933446:0:5926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173370694367ns, next at 174370692774ns, rc = 0 00000040:00080000:2.0:1789762870.933464:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789762870.933468:0:5926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173370716514ns, next at 174370715882ns, rc = 0 00010000:00010000:2.0:1789762870.933494:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933501:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933506:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933511:0:5926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933515:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933520:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933554:0:5926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762870.933568:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933576:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933584:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762870.933584:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933594:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762870.933595:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933598:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933605:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762870.933609:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933610:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933630:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933635:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:2.0:1789762870.933639:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762870.933644:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933647:0:6926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9b33ed2a9a00) 00010000:00010000:0.0:1789762870.933653:0:6926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762870.933657:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a0e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933665:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933671:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5a0e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933673:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933681:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933686:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762870.933687:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762870.933690:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762870.933691:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762870.933699:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762870.933702:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933707:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933714:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762870.933715:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762870.933717:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.933721:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5a0d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762870.933729:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d04dc888 reply state 0000000074ba70f5 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762870.933735:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762870.933792:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:11096:x1876702246553856:12345-192.168.203.36@tcp:36:rm.0 Request processed in 728us (811us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789762870.933799:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 123 00010000:00010000:2.0:1789762870.934395:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.934400:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.934405:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.934417:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762870.934419:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.934424:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.934430:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x3950208a (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762870.934431:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762870.934433:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.934438:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a0db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762870.935912:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762870.935949:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246554112 00000100:00100000:1.0:1789762870.935954:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246554112 00000100:00100000:1.0:1789762870.935986:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:1.0:1789762870.935992:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:11096:x1876702246554112:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:1.0:1789762870.936012:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789762870.936023:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4000/0x5915dfb1c1b5a087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894464f expref: 34 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936041:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4400/0x5915dfb1c1b5a05d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944633 expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936055:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b34021f7800/0x5915dfb1c1b59f76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445d8 expref: 32 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936066:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:1.0:1789762870.936073:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762870.936084:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936091:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936097:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936123:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936129:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936134:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936171:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936179:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936187:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789762870.936284:0:5925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00000040:00080000:1.0:1789762870.936294:0:5925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:1.0:1789762870.936317:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936326:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936334:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936341:0:5925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936349:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936356:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936373:0:5925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762870.936389:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.936390:0:8854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762870.936396:0:8854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936403:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936411:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.936415:0:8854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762870.936416:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762870.936420:0:8854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936421:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.936439:0:8854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936440:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936462:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535900) 00010000:00010000:1.0:1789762870.936465:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762870.936468:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.936473:0:8854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b33f4535900) 00010000:00010000:1.0:1789762870.936474:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a0fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.936481:0:8854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762870.936485:0:8854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936489:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936495:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.936513:0:8854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a105 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936515:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936528:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762870.936536:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762870.936540:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.936541:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762870.936545:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762870.936553:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936565:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:1.0:1789762870.936567:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762870.936569:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762870.936573:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a0f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762870.936581:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063a2c037 reply state 00000000f6ec72fc transno 4294967380 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762870.936585:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762870.936618:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11096:x1876702246554112:12345-192.168.203.36@tcp:36:rm.0 Request processed in 626us (707us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789762870.936623:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 124 00010000:00010000:2.0:1789762870.937133:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.937140:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.937144:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.937148:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762870.937150:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.937154:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.937161:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x25a23cf0 (ffff9b33f4535800) 00010000:00010000:2.0:1789762870.937163:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762870.937165:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.937169:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a0f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762870.937543:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762870.937575:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246554368 00000100:00100000:2.0:1789762870.937585:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246554368 00000100:00100000:2.0:1789762870.937616:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:2.0:1789762870.937625:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11096:x1876702246554368:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762870.937721:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11096:x1876702246554368:12345-192.168.203.36@tcp:35:rm.0 Request processed in 96us (177us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789762870.937730:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:0.0:1789762870.938358:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762870.938393:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246554624 00000100:00100000:3.0:1789762870.938398:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246554624 00000100:00100000:3.0:1789762870.938426:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:3.0:1789762870.938432:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11096:x1876702246554624:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:3.0:1789762870.938453:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789762870.938463:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b59f84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445df expref: 33 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938476:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b59f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445bc expref: 32 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938483:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:3.0:1789762870.938490:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b59eab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789445a7 expref: 31 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938496:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:3.0:1789762870.938499:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762870.938509:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938516:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938521:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938529:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938540:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938545:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938577:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938583:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938588:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762870.938669:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 4096 00010000:00010000:3.0:1789762870.938677:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938681:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938686:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938689:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762870.938691:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938695:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938709:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b33e2f49200) 00010000:00010000:3.0:1789762870.938711:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762870.938714:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938718:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a11a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938728:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938732:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938736:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938740:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762870.938742:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938745:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938771:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:3.0:1789762870.938773:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762870.938776:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762870.938780:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a10c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762870.938799:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076df3a80 reply state 0000000074395721 transno 4294967382 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762870.938804:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762870.938837:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11096:x1876702246554624:12345-192.168.203.36@tcp:36:rm.0 Request processed in 405us (479us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1789762870.938843:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 125 00010000:00010000:2.0:1789762870.939339:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.939346:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.939350:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.939354:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762870.939356:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.939361:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.939367:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33e2f49900) 00010000:00010000:2.0:1789762870.939369:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762870.939371:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762870.939375:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4c00/0x5915dfb1c1b5a113 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762871.099879:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762871.099906:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254911360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762871.099965:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762871.100007:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254911360 00000100:00100000:0.0:1789762871.100016:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254911360 00000100:00100000:0.0:1789762871.100071:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789762871.100073:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762871.100084:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254911360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762871.100106:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 510157376 pending 16875520 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762871.100170:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254911360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762871.100178:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789762871.100211:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254911360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762871.162840:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762871.214389:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.214429:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246554752 00000100:00100000:1.0:1789762871.214438:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246554752 00000100:00080000:3.0:1789762871.214479:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762871.214498:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:1.0:1789762871.214509:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:11107:x1876702246554752:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:1.0:1789762871.214529:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762871.214545:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944679 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.214599:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.214617:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.214627:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762871.214666:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762871.214671:0:7598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762871.214691:0:7598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.214717:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944679 expref: 33 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.214733:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944679 expref: 32 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.214740:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:1.0:1789762871.214742:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762871.214744:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da6200, rc 0) 00000100:00100000:1.0:1789762871.214817:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11107:x1876702246554752:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 310us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762871.214825:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:0.0:1789762871.215901:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762871.215936:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246555008 00000100:00100000:2.0:1789762871.215942:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246555008 00000100:00100000:2.0:1789762871.215976:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:2.0:1789762871.215984:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11107:x1876702246555008:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:2.0:1789762871.216013:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762871.216037:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944679 expref: 32 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216049:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:2.0:1789762871.216056:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762871.216104:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216128:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216134:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216146:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216151:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216156:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762871.216565:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00010000:00010000:2.0:1789762871.216573:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216579:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216591:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216596:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762871.216600:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216605:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216613:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762871.216615:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762871.216618:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.216622:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a12f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762871.216633:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee70babe reply state 000000004025364d transno 4294967383 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762871.216639:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762871.216688:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11107:x1876702246555008:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 705us (787us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1789762871.216702:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 127 00010000:00010000:2.0:1789762871.217238:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.217245:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.217250:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.217254:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762871.217257:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.217261:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.217268:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33ed2a9600) 00010000:00010000:2.0:1789762871.217270:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762871.217273:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.217277:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a136 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.222802:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.222852:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246555136 00000100:00100000:1.0:1789762871.222862:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246555136 00000100:00100000:1.0:1789762871.222920:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:1.0:1789762871.222934:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11108:x1876702246555136:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762871.222955:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762871.222980:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a13d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944680 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.223034:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7200/0x5915dfb1c1b5a144 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.223047:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7200/0x5915dfb1c1b5a144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.223059:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7200/0x5915dfb1c1b5a144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762871.223093:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762871.223098:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762871.223130:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7200/0x5915dfb1c1b5a144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.223156:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a13d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944680 expref: 34 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.223176:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7200/0x5915dfb1c1b5a144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944680 expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.223187:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535a00) 00010000:00010000:1.0:1789762871.223191:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762871.223195:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7200, rc 0) 00000100:00100000:1.0:1789762871.223257:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11108:x1876702246555136:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 326us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762871.223267:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:3.0:1789762871.224315:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762871.224347:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246555392 00000100:00100000:2.0:1789762871.224352:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246555392 00000100:00100000:2.0:1789762871.224383:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:2.0:1789762871.224389:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11108:x1876702246555392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762871.224397:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762871.224405:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762871.224417:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7200/0x5915dfb1c1b5a144 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944680 expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224427:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535a00) 00010000:00010000:2.0:1789762871.224432:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762871.224439:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a14b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944687 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224514:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224529:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224535:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224543:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224547:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224552:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224586:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224592:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224605:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762871.224612:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00010000:00010000:2.0:1789762871.224627:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224632:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224637:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224641:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762871.224644:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224649:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224654:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33ed2a9500) 00010000:00010000:2.0:1789762871.224656:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762871.224659:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224663:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5a160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224674:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224678:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224688:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224692:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762871.224694:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224698:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224704:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:2.0:1789762871.224705:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762871.224707:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224711:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5a152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224716:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224721:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224725:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224729:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762871.224731:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224742:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224748:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762871.224889:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762871.224892:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224897:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a159 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224916:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a14b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944687 expref: 33 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224922:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9600) 00010000:00010000:2.0:1789762871.224924:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762871.224927:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a14b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944687 expref: 33 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.224934:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461000, rc 0) 00000100:00100000:2.0:1789762871.224962:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11108:x1876702246555392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 573us (647us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762871.224967:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:2.0:1789762871.225736:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.225796:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246555520 00000100:00100000:1.0:1789762871.225808:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246555520 00000100:00100000:1.0:1789762871.225844:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 130 00000100:00100000:1.0:1789762871.225853:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:11108:x1876702246555520:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762871.225863:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762871.225876:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894468e expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.225908:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a16e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.225918:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a16e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.225927:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a16e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762871.225947:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762871.225951:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762871.225963:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a16e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.225982:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894468e expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.225998:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a16e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894468e expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.226006:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:1.0:1789762871.226010:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762871.226013:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7e00, rc 0) 00000100:00100000:1.0:1789762871.226055:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11108:x1876702246555520:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 202us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762871.226065:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 130 00000100:00100000:2.0:1789762871.226922:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.226952:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246555776 00000100:00100000:3.0:1789762871.226957:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246555776 00000100:00100000:3.0:1789762871.226996:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:3.0:1789762871.227004:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:11108:x1876702246555776:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762871.227012:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762871.227021:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944695 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227050:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227057:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227063:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227081:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227087:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227092:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762871.227143:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00010000:00010000:3.0:1789762871.227193:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227198:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227202:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227205:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.227208:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227213:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227220:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:3.0:1789762871.227222:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.227224:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227237:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a17c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227245:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227249:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227253:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227257:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.227259:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227263:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227268:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33e2f49200) 00010000:00010000:3.0:1789762871.227270:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.227271:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227275:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a183 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227295:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a175 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944695 expref: 35 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227310:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:3.0:1789762871.227312:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762871.227314:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944695 expref: 35 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.227321:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5c00, rc 0) 00000100:00100000:3.0:1789762871.227346:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:11108:x1876702246555776:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 345us (425us total) trans 4294967384 rc 301/301 00000100:00100000:3.0:1789762871.227351:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:3.0:1789762871.228148:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.228184:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246556032 00000100:00100000:1.0:1789762871.228191:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246556032 00000100:00100000:1.0:1789762871.228227:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:1.0:1789762871.228238:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:11108:x1876702246556032:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:1.0:1789762871.228280:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.228292:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.228301:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762871.228400:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058293d9b reply state 00000000d5a41bc7 transno 4294967385 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762871.228410:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762871.228416:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00000100:00100000:1.0:1789762871.228470:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:11108:x1876702246556032:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 234us (321us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1789762871.228480:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 132 00010000:00010000:1.0:1789762871.228981:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.228991:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.228999:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.229014:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762871.229018:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.229027:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.229040:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33f4535e00) 00010000:00010000:1.0:1789762871.229043:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789762871.229047:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.229055:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6e00/0x5915dfb1c1b5a191 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.229105:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.229157:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246556288 00000100:00100000:1.0:1789762871.229163:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246556288 00000100:00100000:1.0:1789762871.229199:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:1.0:1789762871.229210:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:11108:x1876702246556288:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1789762871.229324:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:11108:x1876702246556288:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 116us (218us total) trans 4294967386 rc 0/0 00000100:00100000:1.0:1789762871.229333:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:2.0:1789762871.233323:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762871.233362:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246556416 00000100:00100000:0.0:1789762871.233367:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246556416 00000100:00100000:0.0:1789762871.233400:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 133 00000100:00100000:0.0:1789762871.233408:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:11109:x1876702246556416:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:0.0:1789762871.233420:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762871.233429:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894469c expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233461:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233479:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233486:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233497:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233503:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233508:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233553:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a1ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233559:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233564:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762871.233586:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00000004:00200000:0.0:1789762871.233591:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762871.233607:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a1ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233618:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233634:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233638:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233642:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762871.233644:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233649:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233656:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:0.0:1789762871.233658:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762871.233660:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233665:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a19f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233672:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233678:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233685:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233690:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762871.233701:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233709:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233719:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33f721dc00) 00010000:00010000:0.0:1789762871.233723:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762871.233726:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233732:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233917:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894469c expref: 38 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233928:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a1ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894469c expref: 37 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.233933:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33f721de00) 00010000:00010000:0.0:1789762871.233935:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762871.233936:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054800, rc 0) 00000100:00100000:0.0:1789762871.233969:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11109:x1876702246556416:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 562us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762871.233974:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 133 00000100:00100000:2.0:1789762871.234968:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.235014:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246556672 00000100:00100000:1.0:1789762871.235021:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246556672 00000100:00100000:1.0:1789762871.235067:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 134 00000100:00100000:1.0:1789762871.235080:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11109:x1876702246556672:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:1.0:1789762871.235133:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762871.235155:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a1ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894469c expref: 37 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.235170:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33f721de00) 00010000:00010000:1.0:1789762871.235180:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762871.235194:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.235205:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.235215:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762871.235294:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7dd5d07 reply state 00000000be7ccb35 transno 4294967387 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762871.235306:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762871.235310:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00000100:00100000:1.0:1789762871.235361:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:11109:x1876702246556672:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 284us (392us total) trans 4294967387 rc 0/0 00000100:00100000:1.0:1789762871.235370:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 134 00010000:00010000:2.0:1789762871.235890:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.235905:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.235911:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.235915:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762871.235918:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.235922:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.235931:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33f4535e00) 00010000:00010000:2.0:1789762871.235933:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762871.235935:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.235940:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6200/0x5915dfb1c1b5a1b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.240458:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.240520:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246556800 00000100:00100000:3.0:1789762871.240525:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246556800 00000100:00100000:3.0:1789762871.240557:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 135 00000100:00100000:3.0:1789762871.240565:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:11110:x1876702246556800:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:3.0:1789762871.240576:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762871.240586:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a1bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446a3 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240632:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240641:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240649:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240667:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240673:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240679:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240721:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a1d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240726:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240731:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762871.240747:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00000004:00200000:3.0:1789762871.240799:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762871.240811:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240818:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240823:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240828:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240842:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.240845:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240851:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240859:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:3.0:1789762871.240862:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.240864:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240869:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a1c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240878:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240882:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240887:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240890:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.240892:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240895:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240909:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33e2f49200) 00010000:00010000:3.0:1789762871.240911:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.240913:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240917:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a1c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240936:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a1bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446a3 expref: 39 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240945:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446a3 expref: 38 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.240950:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:3.0:1789762871.240951:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789762871.240953:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5800, rc 0) 00000100:00100000:3.0:1789762871.240985:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:11110:x1876702246556800:12345-192.168.203.36@tcp:101:touch.500 Request processed in 422us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762871.240991:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 135 00000100:00100000:3.0:1789762871.241878:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.241905:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246557056 00000100:00100000:3.0:1789762871.241910:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246557056 00000100:00100000:3.0:1789762871.241941:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:3.0:1789762871.241950:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:11110:x1876702246557056:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:3.0:1789762871.241958:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762871.241969:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5200/0x5915dfb1c1b5a1d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446aa expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242026:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242035:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242041:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242121:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242129:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242136:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762871.242416:0:5925:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7:0x0], index 0: 0 00010000:00010000:3.0:1789762871.242521:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b5a1ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242528:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b5a1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242536:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b5a1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242559:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242572:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242577:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242581:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.242585:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242591:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242599:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:3.0:1789762871.242601:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.242604:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242608:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a1de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762871.242620:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000349e9334 reply state 0000000026f1d2ac transno 4294967388 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.242626:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762871.242647:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5200/0x5915dfb1c1b5a1d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446aa expref: 41 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242658:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b5a1ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446aa expref: 40 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.242672:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49e00) 00010000:00010000:3.0:1789762871.242674:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762871.242676:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de4a00, rc 0) 00000100:00100000:3.0:1789762871.242715:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:11110:x1876702246557056:12345-192.168.203.36@tcp:101:touch.500 Request processed in 767us (839us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789762871.242721:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 136 00010000:00010000:3.0:1789762871.243261:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.243269:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.243273:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.243277:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.243280:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.243284:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.243290:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff9b33e2f49400) 00010000:00010000:3.0:1789762871.243292:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.243294:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.243298:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4200/0x5915dfb1c1b5a1e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762871.243941:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762871.243970:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246557312 00000100:00100000:0.0:1789762871.243977:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246557312 00000100:00100000:0.0:1789762871.244017:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:0.0:1789762871.244028:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:11110:x1876702246557312:12345-192.168.203.36@tcp:36:touch.500 00010000:00010000:0.0:1789762871.244061:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762871.244073:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4a00/0x5915dfb1c1b5a1ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446aa expref: 40 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244084:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49e00) 00010000:00010000:0.0:1789762871.244091:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762871.244129:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244137:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244144:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762871.244190:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e017676a reply state 0000000099733aef transno 4294967389 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762871.244196:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762871.244244:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:11110:x1876702246557312:12345-192.168.203.36@tcp:36:touch.500 Request processed in 218us (305us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789762871.244249:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 137 00010000:00010000:0.0:1789762871.244898:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244907:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244915:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244933:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762871.244937:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244944:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244955:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33f721dc00) 00010000:00010000:0.0:1789762871.244958:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762871.244962:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.244969:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a1fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762871.245069:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.245097:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246557440 00000100:00100000:3.0:1789762871.245104:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246557440 00000100:00100000:3.0:1789762871.245176:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 138 00000100:00100000:3.0:1789762871.245183:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:11110:x1876702246557440:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:3.0:1789762871.245192:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762871.245200:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b5a201 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446b1 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.245222:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b5a201 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446b1 expref: 41 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.245230:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b5a201 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446b1 expref: 41 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.245240:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:3.0:1789762871.245242:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789762871.245244:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5a00, rc 0) 00000100:00100000:3.0:1789762871.245267:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:11110:x1876702246557440:12345-192.168.203.36@tcp:101:touch.500 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762871.245273:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 138 00000100:00100000:3.0:1789762871.246038:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.246088:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246557568 00000100:00100000:1.0:1789762871.246093:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246557568 00000100:00080000:3.0:1789762871.246139:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762871.246171:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:1.0:1789762871.246183:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2354:x1876702246557568:12345-192.168.203.36@tcp:2:touch.500 00000100:00100000:1.0:1789762871.246370:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2354:x1876702246557568:12345-192.168.203.36@tcp:2:touch.500 Request processed in 189us (335us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1789762871.246390:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:0.0:1789762871.247153:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.247195:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246557824 00000100:00100000:3.0:1789762871.247201:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246557824 00000001:00080000:0.0:1789762871.247216:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967424 is committed 00000100:00100000:3.0:1789762871.247236:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:3.0:1789762871.247244:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:11110:x1876702246557824:12345-192.168.203.36@tcp:35:touch.500 00000100:00100000:3.0:1789762871.247375:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:11110:x1876702246557824:12345-192.168.203.36@tcp:35:touch.500 Request processed in 132us (222us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789762871.247384:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:0.0:1789762871.251837:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.251881:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246557952 00000100:00100000:1.0:1789762871.251889:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246557952 00000100:00100000:1.0:1789762871.251944:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 139 00000100:00100000:1.0:1789762871.251956:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+42:11111:x1876702246557952:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1789762871.251972:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762871.251984:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446b8 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252028:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252041:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252052:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252067:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252075:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252083:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252149:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a21d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252170:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252178:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762871.252204:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 0 00000004:00200000:1.0:1789762871.252208:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762871.252222:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252232:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252240:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252247:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252254:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252259:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762871.252262:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252269:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252279:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:1.0:1789762871.252287:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762871.252292:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252299:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a20f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252311:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252318:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252325:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252330:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762871.252334:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252341:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252349:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff9b33f4535400) 00010000:00010000:1.0:1789762871.252352:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762871.252355:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252361:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6a00/0x5915dfb1c1b5a216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252389:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446b8 expref: 44 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252408:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a21d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446b8 expref: 43 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.252416:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:1.0:1789762871.252419:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762871.252421:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7800, rc 0) 00000100:00100000:1.0:1789762871.252462:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+43:11111:x1876702246557952:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 509us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762871.252470:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 139 00000100:00100000:0.0:1789762871.253477:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.253514:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246558080 00000100:00100000:3.0:1789762871.253520:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246558080 00000100:00100000:3.0:1789762871.253548:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:3.0:1789762871.253554:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246558080:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:3.0:1789762871.253562:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762871.253572:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446bf expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762871.253587:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x6aad9d37, atime: 0x6aad9d37, ctime: 0x6aad9d37, blocks: 0x0 00010000:00010000:3.0:1789762871.253598:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=173s v=(0 0) 00010000:00010000:3.0:1789762871.253602:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762871.253608:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 8 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.253620:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 8 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.253628:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de4200, rc 0) 00000100:00100000:3.0:1789762871.253653:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246558080:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 100us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762871.253657:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:0.0:1789762871.266053:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.266122:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246558336 00000100:00100000:1.0:1789762871.266130:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246558336 00000100:00100000:1.0:1789762871.266170:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 140 00000100:00100000:1.0:1789762871.266180:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+43:11111:x1876702246558336:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:1.0:1789762871.266214:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762871.266230:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a21d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446b8 expref: 43 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.266243:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:1.0:1789762871.266247:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762871.266264:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.266275:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.266284:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762871.266391:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009104587d reply state 000000002b616095 transno 4294967391 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762871.266401:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762871.266462:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+44:11111:x1876702246558336:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 283us (412us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789762871.266471:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 140 00010000:00010000:3.0:1789762871.267001:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.267016:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.267021:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.267025:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.267028:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.267033:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.267040:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:3.0:1789762871.267042:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762871.267045:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.267049:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6600/0x5915dfb1c1b5a22b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762871.267241:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762871.267302:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246558464 00000100:00100000:2.0:1789762871.267308:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246558464 00000100:00100000:2.0:1789762871.267337:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:2.0:1789762871.267345:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246558464:12345-192.168.203.36@tcp:2:chmod.0 00002000:00010000:2.0:1789762871.267437:0:6911:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789762871.267441:0:6911:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762871 -> 1789762871 00002000:00010000:2.0:1789762871.267444:0:6911:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb atime from disk: 1789762871 -> 1789762871 00002000:00010000:2.0:1789762871.267447:0:6911:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762871 -> 1789762871 00002000:00010000:2.0:1789762871.267455:0:6911:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789762871.267486:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2354:x1876702246558464:12345-192.168.203.36@tcp:2:chmod.0 Request processed in 142us (245us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1789762871.267491:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:0.0:1789762871.287733:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.287779:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246558720 00000100:00100000:3.0:1789762871.287787:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246558720 00000100:00100000:3.0:1789762871.287831:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:3.0:1789762871.287840:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+43:11117:x1876702246558720:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762871.287857:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762871.287869:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5200/0x5915dfb1c1b5a232 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446c6 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.287972:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.287996:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288008:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288025:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288033:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288039:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288077:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288083:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288087:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762871.288094:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 0 00010000:00010000:3.0:1789762871.288162:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288167:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288171:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288181:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.288184:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288190:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288198:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:3.0:1789762871.288200:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.288203:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288207:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4e00/0x5915dfb1c1b5a239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288215:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288219:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288223:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288226:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762871.288228:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288232:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288243:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff9b33e2f49300) 00010000:00010000:3.0:1789762871.288244:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762871.288246:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288250:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5c00/0x5915dfb1c1b5a240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288280:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5200/0x5915dfb1c1b5a232 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446c6 expref: 46 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288288:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446c6 expref: 45 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.288293:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:3.0:1789762871.288294:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762871.288296:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de5e00, rc 0) 00000100:00100000:3.0:1789762871.288339:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+45:11117:x1876702246558720:12345-192.168.203.36@tcp:101:dd.500 Request processed in 500us (614us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789762871.288344:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:0.0:1789762871.289330:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.289362:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246558848 00000100:00100000:3.0:1789762871.289368:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246558848 00000100:00100000:3.0:1789762871.289396:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:3.0:1789762871.289401:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+45:11117:x1876702246558848:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762871.289410:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762871.289418:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a255 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446cd expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.289446:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b5a25c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.289453:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b5a25c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.289459:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b5a25c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.289527:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5600/0x5915dfb1c1b5a255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446cd expref: 47 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.289538:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b5a25c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446cd expref: 46 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.289543:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:3.0:1789762871.289545:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762871.289547:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4de4600, rc 0) 00000100:00100000:3.0:1789762871.289574:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:11117:x1876702246558848:12345-192.168.203.36@tcp:101:dd.500 Request processed in 173us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762871.289578:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:0.0:1789762871.290375:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762871.290431:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246559104 00000100:00100000:2.0:1789762871.290438:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246559104 00000100:00100000:2.0:1789762871.290474:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 143 00000100:00100000:2.0:1789762871.290481:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+46:11117:x1876702246559104:12345-192.168.203.36@tcp:36:dd.500 00010000:00010000:2.0:1789762871.290515:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762871.290529:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5e00/0x5915dfb1c1b5a247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446c6 expref: 46 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.290545:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:2.0:1789762871.290549:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762871.290636:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.290644:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.290650:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762871.290690:0:12191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789762871.290703:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b72e09a reply state 00000000e767b94f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762871.290709:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762871.290783:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+48:11117:x1876702246559104:12345-192.168.203.36@tcp:36:dd.500 Request processed in 302us (408us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789762871.290799:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 143 00000020:00080000:2.0:1789762871.290803:0:12191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789762871.291301:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.291308:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.291312:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.291315:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762871.291318:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.291322:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.291328:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:2.0:1789762871.291330:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762871.291332:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.291335:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a263 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762871.291500:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.291540:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246559232 00000100:00100000:1.0:1789762871.291545:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246559232 00000100:00100000:1.0:1789762871.291591:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:1.0:1789762871.291601:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:11117:x1876702246559232:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:1.0:1789762871.291610:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762871.291622:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446d4 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.291644:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 10 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.291653:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762871.291658:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762871.291663:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.291703:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 10 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.291730:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 10 pid: 7959 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762871.291744:0:6909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1876702254911488:192.168.203.36@tcp:104: 00000100:00100000:1.0:1789762871.291870:0:6909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f8d2f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789762871.292651:0:6909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1876702254911488:192.168.203.36@tcp:104: 00010000:00010000:1.0:1789762871.292674:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.292687:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7800, rc 0) 00000100:00100000:1.0:1789762871.292718:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:11117:x1876702246559232:12345-192.168.203.36@tcp:101:dd.500 Request processed in 1119us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762871.292725:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:2.0:1789762871.292887:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762871.292927:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246559360 00000100:00100000:0.0:1789762871.292932:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246559360 00010000:00010000:0.0:1789762871.292951:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 10 pid: 7959 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762871.292987:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1789762871.292992:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246559360:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762871.293001:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762871.293006:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 10 pid: 7959 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.293017:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 10 pid: 7959 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.293034:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a224 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446bf expref: 10 pid: 7959 timeout: 273 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.293046:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762871.293050:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762871.293057:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 9 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.293067:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 9 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.293089:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 9 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762871.293121:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3051f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254911616:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762871.293163:0:5910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33fed37840 going to sleep for 11 seconds 00000100:00100000:2.0:1789762871.293887:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3051f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254911616:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762871.293898:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762871.293924:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2354:x1876702246559360:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 931us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762871.293936:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:3.0:1789762871.294090:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.294146:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246559488 00000100:00100000:1.0:1789762871.294152:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246559488 00002000:00010000:1.0:1789762871.294172:0:12137:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/7 (0->18446744073709551615) 00002000:00100000:1.0:1789762871.294176:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4517100 with x1876702246559488 ext(0->18446744073709551615) 00002000:00010000:1.0:1789762871.294183:0:12137:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4517100. 00000100:00100000:1.0:1789762871.294195:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173205209145 time 173205382745 state 0x0 ref 1 00000100:00100000:1.0:1789762871.294206:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173405382745 time 173205382745 state 0x1 ref 1 00000100:00100000:1.0:1789762871.294230:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 173405382745 time 173731474848 state 0x0 ref 1 00000100:00100000:1.0:1789762871.294242:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2354:x1876702246559488:12345-192.168.203.36@tcp:10:dd.500 00002000:00010000:1.0:1789762871.294362:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789762871.294366:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762871 -> 1789762871 00002000:00010000:1.0:1789762871.294369:0:12137:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb atime from disk: 1789762871 -> 1789762871 00002000:00010000:1.0:1789762871.294372:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762871 -> 1789762871 00002000:00010000:1.0:1789762871.294375:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789762871.294408:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246559488:12345-192.168.203.36@tcp:10:dd.500 Request processed in 168us (375us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1789762871.294418:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:1.0:1789762871.294425:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 173405382745 time 173731474848 state 0x2 ref 0 00002000:00010000:1.0:1789762871.294431:0:12137:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/7 (0->18446744073709551615) 00002000:00100000:1.0:1789762871.294435:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4517100 with x1876702246559488 ext(0->18446744073709551615) 00002000:00010000:1.0:1789762871.294440:0:12137:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4517100. 00000100:00100000:1.0:1789762871.297147:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.297189:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246559616 00000100:00100000:3.0:1789762871.297194:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246559616 00000100:00100000:3.0:1789762871.297214:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 173405382745 time 173731474848 state 0x0 ref 1 00000100:00100000:3.0:1789762871.297220:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 1 deadline 173931474848 time 173731474848 state 0x1 ref 1 00000100:00100000:3.0:1789762871.297246:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173931474848 time 173734492874 state 0x0 ref 1 00000100:00100000:3.0:1789762871.297255:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246559616:12345-192.168.203.36@tcp:4:dd.500 00010000:00010000:3.0:1789762871.297271:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.297281:0:6917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.297287:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762871.297290:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762871.297293:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.297352:0:6917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.297361:0:6917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 10 pid: 6909 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.297368:0:6917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:6917:1876702254911744:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762871.297404:0:6917:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f47b50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789762871.298310:0:6917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:6917:1876702254911744:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762871.298324:0:6917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762871.298378:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.298439:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246559744 00000100:00100000:3.0:1789762871.298443:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246559744 00010000:00010000:3.0:1789762871.298458:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 11 pid: 6909 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.298481:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:3.0:1789762871.298486:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2354:x1876702246559744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762871.298494:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762871.298503:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 11 pid: 6909 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.298511:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 11 pid: 6909 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.298523:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5a26a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446d4 expref: 11 pid: 6909 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.298532:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762871.298535:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762871.298538:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.298543:0:5911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.298568:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762871.298591:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246559744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762871.298597:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00010000:00010000:1.0:1789762871.298605:0:6917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.298618:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762871.303237:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967427 is committed 00002000:00010000:3.0:1789762871.303300:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789762871.303305:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1789762871.303313:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.303322:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.303327:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.303332:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762871.303335:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.303341:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.303351:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.303356:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.303410:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2355:x1876702246559616:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6155us (6263us total) trans 4294967427 rc 0/0 00000100:00100000:3.0:1789762871.303417:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1789762871.303422:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173931474848 time 173734492874 state 0x2 ref 0 00000100:00100000:0.0:1789762871.305343:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.305375:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246559872 00000100:00100000:3.0:1789762871.305381:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246559872 00000100:00100000:3.0:1789762871.305405:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173931474848 time 173734492874 state 0x0 ref 1 00000100:00100000:3.0:1789762871.305413:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173934492874 time 173734492874 state 0x1 ref 1 00000100:00100000:2.0:1789762871.497345:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173934492874 time 173934583850 state 0x0 ref 1 00000100:00100000:2.0:1789762871.497380:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2356:x1876702246559872:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762871.497432:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 1048576, mtime: 0x6aad9d37, atime: 0x6aad9d37, ctime: 0x6aad9d37, blocks: 0x800 00010000:00010000:2.0:1789762871.497439:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.497452:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=173s v=(0 0) 00010000:00010000:2.0:1789762871.497456:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762871.497460:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.497471:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762871.502441:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967428 is committed 00002000:00010000:3.0:1789762871.502521:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1789762871.502527:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:3.0:1789762871.502537:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.502546:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.502552:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.502557:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762871.502561:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.502568:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.502589:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762871.502594:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c918535e/0x5915dfb1c1b5a278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762871.502650:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2356:x1876702246559872:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5289us (197307us total) trans 4294967428 rc 0/0 00000100:00100000:3.0:1789762871.502657:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:3.0:1789762871.502662:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173934492874 time 173934583850 state 0x2 ref 0 00000100:00100000:2.0:1789762871.504840:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762871.504891:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560000 00000100:00100000:1.0:1789762871.504899:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560000 00000100:00100000:1.0:1789762871.504932:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 173934492874 time 173934583850 state 0x0 ref 1 00000100:00100000:1.0:1789762871.504941:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174134583850 time 173934583850 state 0x1 ref 1 00000100:00100000:0.0:1789762871.697513:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174134583850 time 174134751432 state 0x0 ref 1 00000100:00100000:0.0:1789762871.697542:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560000:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762871.697601:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 2097152, mtime: 0x6aad9d37, atime: 0x6aad9d37, ctime: 0x6aad9d37, blocks: 0x1000 00010000:00010000:0.0:1789762871.697609:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.697622:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=174s v=(0 0) 00010000:00010000:0.0:1789762871.697626:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762871.697630:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.697643:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762871.703006:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967429 is committed 00002000:00010000:2.0:1789762871.703084:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789762871.703089:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:2.0:1789762871.703099:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.703122:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.703129:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.703141:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762871.703145:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.703151:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.703166:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762871.703171:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5a27f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762871.703229:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560000:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5700us (198389us total) trans 4294967429 rc 0/0 00000100:00100000:2.0:1789762871.703237:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:2.0:1789762871.703243:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174134583850 time 174134751432 state 0x2 ref 0 00000100:00100000:1.0:1789762871.705968:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762871.706020:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560128 00000100:00100000:3.0:1789762871.706027:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560128 00000100:00100000:3.0:1789762871.706060:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174134583850 time 174134751432 state 0x0 ref 1 00000100:00100000:3.0:1789762871.706069:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174334751432 time 174134751432 state 0x1 ref 1 00000100:00100000:1.0:1789762871.897643:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174334751432 time 174334880594 state 0x0 ref 1 00000100:00100000:1.0:1789762871.897670:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560128:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762871.897718:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 3145728, mtime: 0x6aad9d37, atime: 0x6aad9d37, ctime: 0x6aad9d37, blocks: 0x1800 00010000:00010000:1.0:1789762871.897726:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.897739:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=174s v=(0 0) 00010000:00010000:1.0:1789762871.897742:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762871.897747:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762871.897783:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762871.903137:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967430 is committed 00002000:00010000:0.0:1789762871.903217:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1789762871.903222:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762871 -> 1789762872 00002000:00010000:0.0:1789762871.903224:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762871 -> 1789762872 00002000:00010000:0.0:1789762871.903232:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:0.0:1789762871.903242:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.903252:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.903258:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.903263:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762871.903267:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.903273:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.903287:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762871.903292:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5a286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762871.903351:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560128:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5692us (197382us total) trans 4294967430 rc 0/0 00000100:00100000:0.0:1789762871.903359:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1789762871.903364:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174334751432 time 174334880594 state 0x2 ref 0 00000100:00100000:3.0:1789762871.905629:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762871.905694:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560256 00000100:00100000:2.0:1789762871.905702:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560256 00000100:00100000:2.0:1789762871.905743:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174334751432 time 174334880594 state 0x0 ref 1 00000100:00100000:2.0:1789762871.905770:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174534880594 time 174334880594 state 0x1 ref 1 00000100:00100000:3.0:1789762872.097865:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174534880594 time 174535090141 state 0x0 ref 1 00000100:00100000:3.0:1789762872.097957:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560256:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762872.098049:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 4194304, mtime: 0x6aad9d38, atime: 0x6aad9d37, ctime: 0x6aad9d38, blocks: 0x2000 00010000:00010000:3.0:1789762872.098081:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762872.098157:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=174s v=(0 0) 00010000:00010000:3.0:1789762872.098164:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762872.098173:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762872.098192:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762872.104682:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967431 is committed 00002000:00010000:0.0:1789762872.104776:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1789762872.104781:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:0.0:1789762872.104793:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.104803:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.104810:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.104815:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762872.104819:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.104826:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.104841:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.104846:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a28d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762872.104913:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560256:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7019us (199283us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1789762872.104922:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:0.0:1789762872.104934:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174534880594 time 174535090141 state 0x2 ref 0 00000100:00100000:1.0:1789762872.107646:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762872.107712:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560384 00000100:00100000:2.0:1789762872.107722:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560384 00000100:00100000:2.0:1789762872.107800:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174534880594 time 174535090141 state 0x0 ref 1 00000100:00100000:2.0:1789762872.107820:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174735090141 time 174535090141 state 0x1 ref 1 00010000:00010000:2.0:1789762872.186916:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762872.297958:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174735090141 time 174735196254 state 0x0 ref 1 00000100:00100000:0.0:1789762872.297999:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560384:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762872.298055:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 5242880, mtime: 0x6aad9d38, atime: 0x6aad9d37, ctime: 0x6aad9d38, blocks: 0x2800 00010000:00010000:0.0:1789762872.298066:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.298084:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=174s v=(0 0) 00010000:00010000:0.0:1789762872.298088:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762872.298093:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.298134:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762872.303332:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967432 is committed 00002000:00010000:0.0:1789762872.303402:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789762872.303406:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:0.0:1789762872.303416:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.303425:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.303431:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.303445:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762872.303449:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.303455:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.303470:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762872.303475:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762872.303528:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560384:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5543us (195883us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789762872.303536:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1789762872.303541:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174735090141 time 174735196254 state 0x2 ref 0 00000100:00100000:3.0:1789762872.305986:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762872.306022:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560512 00000100:00100000:0.0:1789762872.306030:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560512 00000100:00100000:0.0:1789762872.306060:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174735090141 time 174735196254 state 0x0 ref 1 00000100:00100000:0.0:1789762872.306069:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174935196254 time 174735196254 state 0x1 ref 1 00000100:00100000:1.0:1789762872.498112:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174935196254 time 174935337852 state 0x0 ref 1 00000100:00100000:1.0:1789762872.498157:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560512:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762872.498225:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 6291456, mtime: 0x6aad9d38, atime: 0x6aad9d37, ctime: 0x6aad9d38, blocks: 0x3000 00010000:00010000:1.0:1789762872.498235:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.498254:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=174s v=(0 0) 00010000:00010000:1.0:1789762872.498258:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762872.498262:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.498287:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762872.503382:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967433 is committed 00002000:00010000:1.0:1789762872.503453:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1789762872.503458:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:1.0:1789762872.503465:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.503485:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.503491:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.503495:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762872.503499:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.503505:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.503517:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.503522:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5a29b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762872.503593:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560512:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5465us (197607us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789762872.503601:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:1.0:1789762872.503606:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174935196254 time 174935337852 state 0x2 ref 0 00000100:00100000:3.0:1789762872.505732:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762872.505785:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560640 00000100:00100000:0.0:1789762872.505794:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560640 00000100:00100000:0.0:1789762872.505827:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 174935196254 time 174935337852 state 0x0 ref 1 00000100:00100000:0.0:1789762872.505842:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175135337852 time 174935337852 state 0x1 ref 1 00000100:00100000:3.0:1789762872.698217:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175135337852 time 175135455534 state 0x0 ref 1 00000100:00100000:3.0:1789762872.698246:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560640:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762872.698292:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 7340032, mtime: 0x6aad9d38, atime: 0x6aad9d37, ctime: 0x6aad9d38, blocks: 0x3800 00010000:00010000:3.0:1789762872.698300:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762872.698317:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=175s v=(0 0) 00010000:00010000:3.0:1789762872.698322:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762872.698329:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762872.698348:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762872.703514:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967434 is committed 00002000:00010000:1.0:1789762872.703574:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:1.0:1789762872.703579:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:1.0:1789762872.703589:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.703597:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.703605:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.703613:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762872.703618:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.703628:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.703647:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762872.703666:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a2a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762872.703719:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560640:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5486us (197987us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789762872.703726:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:1.0:1789762872.703732:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175135337852 time 175135455534 state 0x2 ref 0 00000100:00100000:0.0:1789762872.705877:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762872.705917:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560768 00000100:00100000:3.0:1789762872.705926:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560768 00000100:00100000:3.0:1789762872.705958:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175135337852 time 175135455534 state 0x0 ref 1 00000100:00100000:3.0:1789762872.705967:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175335455534 time 175135455534 state 0x1 ref 1 00000100:00100000:2.0:1789762872.898331:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175335455534 time 175335569734 state 0x0 ref 1 00000100:00100000:2.0:1789762872.898360:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560768:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762872.898409:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 8388608, mtime: 0x6aad9d38, atime: 0x6aad9d37, ctime: 0x6aad9d38, blocks: 0x4000 00010000:00010000:2.0:1789762872.898416:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.898430:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=175s v=(0 0) 00010000:00010000:2.0:1789762872.898434:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762872.898439:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.898450:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762872.903583:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967435 is committed 00002000:00010000:2.0:1789762872.903689:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1789762872.903694:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762872 -> 1789762873 00002000:00010000:2.0:1789762872.903696:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762872 -> 1789762873 00002000:00010000:2.0:1789762872.903698:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:2.0:1789762872.903706:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.903715:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.903728:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.903733:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762872.903737:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.903743:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.903774:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762872.903780:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762872.903833:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246560768:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5487us (197956us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789762872.903839:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:2.0:1789762872.903844:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175335455534 time 175335569734 state 0x2 ref 0 00000100:00100000:3.0:1789762872.905842:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762872.905895:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246560896 00000100:00100000:1.0:1789762872.905903:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246560896 00000100:00100000:1.0:1789762872.905936:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175335455534 time 175335569734 state 0x0 ref 1 00000100:00100000:1.0:1789762872.905944:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175535569734 time 175335569734 state 0x1 ref 1 00000100:00100000:2.0:1789762873.098436:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175535569734 time 175535672929 state 0x0 ref 1 00000100:00100000:2.0:1789762873.098476:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560896:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:3.0:1789762873.098535:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762873.098536:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 9437184, mtime: 0x6aad9d39, atime: 0x6aad9d37, ctime: 0x6aad9d39, blocks: 0x4800 00010000:00010000:2.0:1789762873.098557:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.098570:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=175s v=(0 0) 00010000:00010000:2.0:1789762873.098574:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762873.098579:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.098590:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762873.103987:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967436 is committed 00002000:00010000:2.0:1789762873.104055:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:2.0:1789762873.104060:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 18432 -> 20480 00010000:00010000:2.0:1789762873.104068:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.104077:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.104083:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.104088:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762873.104106:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.104114:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.104134:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762873.104140:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762873.104188:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246560896:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5737us (198346us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789762873.104195:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1789762873.104200:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175535569734 time 175535672929 state 0x2 ref 0 00000100:00100000:0.0:1789762873.106399:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762873.106476:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561024 00000100:00100000:1.0:1789762873.106485:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561024 00000100:00100000:1.0:1789762873.106517:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175535569734 time 175535672929 state 0x0 ref 1 00000100:00100000:1.0:1789762873.106525:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175735672929 time 175535672929 state 0x1 ref 1 00010000:00010000:2.0:1789762873.210913:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762873.298546:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175735672929 time 175735781031 state 0x0 ref 1 00000100:00100000:0.0:1789762873.298579:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561024:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762873.298628:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 10485760, mtime: 0x6aad9d39, atime: 0x6aad9d37, ctime: 0x6aad9d39, blocks: 0x5000 00010000:00010000:0.0:1789762873.298635:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.298656:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=175s v=(0 0) 00010000:00010000:0.0:1789762873.298660:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762873.298664:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.298675:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762873.303529:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967437 is committed 00002000:00010000:1.0:1789762873.303632:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789762873.303637:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 20480 -> 22528 00010000:00010000:1.0:1789762873.303645:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.303653:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.303670:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.303676:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762873.303679:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.303686:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.303699:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.303704:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5a2b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762873.303782:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561024:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5218us (197384us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789762873.303789:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:1.0:1789762873.303795:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175735672929 time 175735781031 state 0x2 ref 0 00000100:00100000:3.0:1789762873.305862:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762873.305906:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561152 00000100:00100000:2.0:1789762873.305915:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561152 00000100:00100000:2.0:1789762873.305948:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175735672929 time 175735781031 state 0x0 ref 1 00000100:00100000:2.0:1789762873.305957:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175935781031 time 175735781031 state 0x1 ref 1 00000100:00100000:0.0:1789762873.498646:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175935781031 time 175935884364 state 0x0 ref 1 00000100:00100000:0.0:1789762873.498675:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561152:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762873.498737:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 11534336, mtime: 0x6aad9d39, atime: 0x6aad9d37, ctime: 0x6aad9d39, blocks: 0x5800 00010000:00010000:0.0:1789762873.498744:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.498786:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=175s v=(0 0) 00010000:00010000:0.0:1789762873.498790:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762873.498796:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.498807:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762873.504054:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967438 is committed 00002000:00010000:0.0:1789762873.504136:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1789762873.504141:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 22528 -> 24576 00010000:00010000:0.0:1789762873.504150:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.504158:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.504164:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.504169:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762873.504173:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.504189:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.504202:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.504207:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a2be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762873.504259:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561152:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5597us (198398us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789762873.504266:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:0.0:1789762873.504272:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175935781031 time 175935884364 state 0x2 ref 0 00000100:00100000:3.0:1789762873.506456:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762873.506513:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561280 00000100:00100000:2.0:1789762873.506522:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561280 00000100:00100000:2.0:1789762873.506554:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 175935781031 time 175935884364 state 0x0 ref 1 00000100:00100000:2.0:1789762873.506563:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176135884364 time 175935884364 state 0x1 ref 1 00000100:00100000:3.0:1789762873.698781:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176135884364 time 176135990469 state 0x0 ref 1 00000100:00100000:3.0:1789762873.698813:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561280:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762873.698868:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 12582912, mtime: 0x6aad9d39, atime: 0x6aad9d37, ctime: 0x6aad9d39, blocks: 0x6000 00010000:00010000:3.0:1789762873.698878:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762873.698894:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=176s v=(0 0) 00010000:00010000:3.0:1789762873.698899:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762873.698906:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762873.698922:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762873.704163:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967439 is committed 00002000:00010000:0.0:1789762873.704239:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1789762873.704243:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:0.0:1789762873.704252:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.704260:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.704267:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.704272:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762873.704282:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.704289:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.704302:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762873.704308:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a2c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762873.704365:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561280:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5565us (197909us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789762873.704384:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:0.0:1789762873.704394:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176135884364 time 176135990469 state 0x2 ref 0 00000100:00100000:3.0:1789762873.706781:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762873.706824:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561408 00000100:00100000:1.0:1789762873.706831:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561408 00000100:00100000:1.0:1789762873.706861:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176135884364 time 176135990469 state 0x0 ref 1 00000100:00100000:1.0:1789762873.706869:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176335990469 time 176135990469 state 0x1 ref 1 00000100:00100000:1.0:1789762873.898810:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176335990469 time 176336049401 state 0x0 ref 1 00000100:00100000:1.0:1789762873.898839:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561408:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762873.898887:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 13631488, mtime: 0x6aad9d39, atime: 0x6aad9d37, ctime: 0x6aad9d39, blocks: 0x6800 00010000:00010000:1.0:1789762873.898895:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.898908:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=176s v=(0 0) 00010000:00010000:1.0:1789762873.898911:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762873.898916:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.898926:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762873.903806:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967440 is committed 00002000:00010000:1.0:1789762873.903907:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:1.0:1789762873.903912:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762873 -> 1789762874 00002000:00010000:1.0:1789762873.903914:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762873 -> 1789762874 00002000:00010000:1.0:1789762873.903916:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 26624 -> 28672 00010000:00010000:1.0:1789762873.903924:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.903932:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.903939:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.903951:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762873.903955:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.903962:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.903975:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762873.903980:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762873.904035:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561408:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5208us (197254us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789762873.904053:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:1.0:1789762873.904059:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176335990469 time 176336049401 state 0x2 ref 0 00000100:00100000:3.0:1789762873.906368:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762873.906442:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561536 00000100:00100000:0.0:1789762873.906450:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561536 00000100:00100000:0.0:1789762873.906482:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176335990469 time 176336049401 state 0x0 ref 1 00000100:00100000:0.0:1789762873.906491:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176536049401 time 176336049401 state 0x1 ref 1 00000100:00100000:1.0:1789762874.098892:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176536049401 time 176536129907 state 0x0 ref 1 00000100:00100000:1.0:1789762874.098919:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561536:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762874.098965:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 14680064, mtime: 0x6aad9d3a, atime: 0x6aad9d37, ctime: 0x6aad9d3a, blocks: 0x7000 00010000:00010000:1.0:1789762874.098972:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.099003:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=176s v=(0 0) 00010000:00010000:1.0:1789762874.099008:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762874.099016:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.099031:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762874.103951:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967441 is committed 00002000:00010000:1.0:1789762874.104056:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:1.0:1789762874.104062:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 28672 -> 30720 00010000:00010000:1.0:1789762874.104071:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.104080:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.104103:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.104108:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762874.104112:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.104119:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.104143:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.104149:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762874.104206:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561536:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5298us (197837us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789762874.104214:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:1.0:1789762874.104220:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176536049401 time 176536129907 state 0x2 ref 0 00000100:00100000:0.0:1789762874.106577:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762874.106613:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561664 00000100:00100000:3.0:1789762874.106621:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561664 00000100:00100000:3.0:1789762874.106653:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176536049401 time 176536129907 state 0x0 ref 1 00000100:00100000:3.0:1789762874.106661:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176736129907 time 176536129907 state 0x1 ref 1 00000100:00100000:0.0:1789762874.170912:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254911872:0@lo:400:kworker.0 00000004:00080000:1.0:1789762874.170936:0:8698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 176608183412ns, next at 177608179767ns, rc = 0 00000100:00100000:2.0:1789762874.170951:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254912128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762874.170957:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254912000:0@lo:400:kworker.0 00000100:00100000:1.0:1789762874.170976:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254912256:0@lo:400:kworker.0 00000100:00100000:0.0:1789762874.170987:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762874.171016:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762874.171030:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762874.171045:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254911872 00000100:00100000:1.0:1789762874.171052:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254911872 00000100:00100000:0.0:1789762874.171057:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254912384:0@lo:400:kworker.0 00000100:00100000:3.0:1789762874.171067:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254912512:0@lo:400:kworker.0 00000100:00100000:2.0:1789762874.171070:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254912640:0@lo:400:kworker.0 00000100:00100000:0.0:1789762874.171115:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762874.171118:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789762874.171129:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254911872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762874.171144:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762874.171145:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912128 00000100:00100000:2.0:1789762874.171151:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912128 00000100:00100000:0.0:1789762874.171175:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912384 00000100:00100000:0.0:1789762874.171180:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912384 00000100:00100000:1.0:1789762874.171192:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254911872:12345-0@lo:400:kworker.0 Request processed in 65us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762874.171198:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912000 00000100:00100000:1.0:1789762874.171202:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789762874.171205:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912000 00000100:00100000:2.0:1789762874.171210:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789762874.171221:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789762874.171222:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254912128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762874.171231:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254912384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762874.171246:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912512 00002000:00000024:2.0:1789762874.171249:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59294272 pending 16973824 free 3906891776 avail 3675369472 00000100:00100000:3.0:1789762874.171250:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912512 00000100:00100000:1.0:1789762874.171260:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762874.171288:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254912384:12345-0@lo:400:kworker.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762874.171288:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912256 00000100:00100000:3.0:1789762874.171293:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912256 00000100:00100000:0.0:1789762874.171301:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789762874.171301:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254912128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762874.171309:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789762874.171313:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789762874.171325:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254912000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762874.171330:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789762874.171338:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762874.171340:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762874.171343:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254912512:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762874.171344:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762874.171352:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762874.171366:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912640 00000100:00100000:2.0:1789762874.171371:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912640 00000100:00100000:1.0:1789762874.171392:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254912000:12345-0@lo:400:kworker.0 Request processed in 69us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762874.171397:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254912512:12345-0@lo:400:kworker.0 Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762874.171407:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789762874.171408:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254912128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762874.171416:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789762874.171422:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254912640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762874.171427:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789762874.171438:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789762874.171455:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254912256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762874.171461:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254912384:0@lo:400:kworker.0 00000100:00100000:1.0:1789762874.171482:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254912000:0@lo:400:kworker.0 00000100:00100000:0.0:1789762874.171483:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254911872:0@lo:400:kworker.0 00000100:00100000:2.0:1789762874.171483:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254912640:12345-0@lo:400:kworker.0 Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762874.171495:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789762874.171513:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254912512:0@lo:400:kworker.0 00000100:00100000:3.0:1789762874.171520:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254912256:12345-0@lo:400:kworker.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762874.171527:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789762874.171540:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254912640:0@lo:400:kworker.0 00000100:00100000:1.0:1789762874.171572:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254912256:0@lo:400:kworker.0 00010000:00010000:2.0:1789762874.234903:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762874.298957:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176736129907 time 176736196186 state 0x0 ref 1 00000100:00100000:2.0:1789762874.298986:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561664:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762874.299044:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 15728640, mtime: 0x6aad9d3a, atime: 0x6aad9d37, ctime: 0x6aad9d3a, blocks: 0x7800 00010000:00010000:2.0:1789762874.299054:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.299095:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=176s v=(0 0) 00010000:00010000:2.0:1789762874.299100:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762874.299105:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.299116:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762874.304121:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967442 is committed 00002000:00010000:2.0:1789762874.304192:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:2.0:1789762874.304197:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 30720 -> 32768 00010000:00010000:2.0:1789762874.304205:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.304213:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.304220:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.304225:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762874.304228:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.304236:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.304261:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.304266:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762874.304320:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561664:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5346us (197742us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789762874.304329:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:2.0:1789762874.304335:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176736129907 time 176736196186 state 0x2 ref 0 00000100:00100000:0.0:1789762874.306584:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762874.306641:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561792 00000100:00100000:1.0:1789762874.306649:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561792 00000100:00100000:1.0:1789762874.306681:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176736129907 time 176736196186 state 0x0 ref 1 00000100:00100000:1.0:1789762874.306689:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176936196186 time 176736196186 state 0x1 ref 1 00000100:00100000:2.0:1789762874.499110:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176936196186 time 176936347057 state 0x0 ref 1 00000100:00100000:2.0:1789762874.499138:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561792:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762874.499185:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 16777216, mtime: 0x6aad9d3a, atime: 0x6aad9d37, ctime: 0x6aad9d3a, blocks: 0x8000 00010000:00010000:2.0:1789762874.499193:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.499208:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=176s v=(0 0) 00010000:00010000:2.0:1789762874.499211:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762874.499216:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.499226:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762874.503881:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967443 is committed 00002000:00010000:2.0:1789762874.503946:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:2.0:1789762874.503951:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 32768 -> 34816 00010000:00010000:2.0:1789762874.503959:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.503967:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.503974:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.503979:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762874.503982:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.503989:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.504003:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762874.504007:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5a2e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762874.504056:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246561792:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4931us (197472us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789762874.504069:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1789762874.504074:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176936196186 time 176936347057 state 0x2 ref 0 00000100:00100000:3.0:1789762874.506146:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762874.506202:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246561920 00000100:00100000:1.0:1789762874.506211:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246561920 00000100:00100000:1.0:1789762874.506245:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 176936196186 time 176936347057 state 0x0 ref 1 00000100:00100000:1.0:1789762874.506253:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177136347057 time 176936347057 state 0x1 ref 1 00000100:00100000:1.0:1789762874.699180:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177136347057 time 177136418969 state 0x0 ref 1 00000100:00100000:1.0:1789762874.699208:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561920:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762874.699257:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 17825792, mtime: 0x6aad9d3a, atime: 0x6aad9d37, ctime: 0x6aad9d3a, blocks: 0x8800 00010000:00010000:1.0:1789762874.699264:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.699278:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=177s v=(0 0) 00010000:00010000:1.0:1789762874.699282:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762874.699287:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.699313:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762874.704295:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967444 is committed 00002000:00010000:1.0:1789762874.704366:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:1.0:1789762874.704371:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 34816 -> 36864 00010000:00010000:1.0:1789762874.704380:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.704389:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.704395:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.704400:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762874.704404:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.704411:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.704424:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762874.704429:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a2e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762874.704488:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246561920:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5291us (198341us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789762874.704495:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:1.0:1789762874.704509:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177136347057 time 177136418969 state 0x2 ref 0 00000100:00100000:3.0:1789762874.706680:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762874.706733:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562048 00000100:00100000:2.0:1789762874.706741:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562048 00000100:00100000:2.0:1789762874.706790:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177136347057 time 177136418969 state 0x0 ref 1 00000100:00100000:2.0:1789762874.706799:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177336418969 time 177136418969 state 0x1 ref 1 00000100:00100000:0.0:1789762874.755727:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762874.755783:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762874.755804:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762874.755830:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562304 00000100:00100000:2.0:1789762874.755831:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562176 00000100:00100000:0.0:1789762874.755837:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762874.755843:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562304 00000100:00100000:2.0:1789762874.755843:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562176 00000100:00100000:3.0:1789762874.755849:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562432 00000100:00100000:3.0:1789762874.755856:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562432 00000100:00100000:0.0:1789762874.755858:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562560 00000100:00100000:0.0:1789762874.755864:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562560 00000100:00100000:2.0:1789762874.755900:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 243 00000100:00100000:2.0:1789762874.755914:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246562176:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762874.755918:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:3.0:1789762874.755920:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:0.0:1789762874.755929:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:1.0:1789762874.755936:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+47:2355:x1876702246562304:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762874.755937:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2356:x1876702246562432:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762874.755944:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246562560:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762874.755982:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246562176:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762874.755984:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:2356:x1876702246562432:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762874.755991:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246562560:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 50us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762874.756000:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+47:2355:x1876702246562304:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 67us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762874.756002:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 243 00000100:00100000:3.0:1789762874.756004:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:0.0:1789762874.756013:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:1.0:1789762874.756020:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00080000:3.0:1789762874.756048:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762874.756053:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762874.899267:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177336418969 time 177336505154 state 0x0 ref 1 00000100:00100000:0.0:1789762874.899296:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246562048:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762874.899357:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 18874368, mtime: 0x6aad9d3a, atime: 0x6aad9d37, ctime: 0x6aad9d3a, blocks: 0x9000 00010000:00010000:0.0:1789762874.899364:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.899378:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=177s v=(0 0) 00010000:00010000:0.0:1789762874.899382:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762874.899386:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.899406:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762874.904880:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967445 is committed 00002000:00010000:0.0:1789762874.904977:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:0.0:1789762874.904982:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762874 -> 1789762875 00002000:00010000:0.0:1789762874.904984:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762874 -> 1789762875 00002000:00010000:0.0:1789762874.904986:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 36864 -> 38912 00010000:00010000:0.0:1789762874.904995:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.905003:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.905019:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.905025:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762874.905035:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.905042:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.905055:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762874.905061:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a2ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762874.905138:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246562048:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5856us (198458us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1789762874.905145:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:0.0:1789762874.905150:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177336418969 time 177336505154 state 0x2 ref 0 00000100:00100000:2.0:1789762874.907544:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762874.907614:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562688 00000100:00100000:0.0:1789762874.907622:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562688 00000100:00100000:0.0:1789762874.907653:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177336418969 time 177336505154 state 0x0 ref 1 00000100:00100000:0.0:1789762874.907662:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177536505154 time 177336505154 state 0x1 ref 1 00000100:00100000:3.0:1789762875.099369:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177536505154 time 177536608471 state 0x0 ref 1 00000100:00100000:3.0:1789762875.099417:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246562688:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:2.0:1789762875.099455:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762875.099466:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 19922944, mtime: 0x6aad9d3b, atime: 0x6aad9d37, ctime: 0x6aad9d3b, blocks: 0x9800 00010000:00010000:3.0:1789762875.099475:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762875.099489:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=177s v=(0 0) 00010000:00010000:3.0:1789762875.099504:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762875.099509:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762875.099521:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762875.104258:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967446 is committed 00002000:00010000:0.0:1789762875.104330:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:0.0:1789762875.104335:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 38912 -> 40960 00010000:00010000:0.0:1789762875.104344:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.104353:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.104371:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.104380:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762875.104385:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.104396:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.104416:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.104422:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a2f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762875.104477:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246562688:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5092us (196933us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789762875.104483:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:0.0:1789762875.104488:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177536505154 time 177536608471 state 0x2 ref 0 00000100:00100000:2.0:1789762875.106870:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762875.106918:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562816 00000100:00100000:1.0:1789762875.106927:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562816 00000100:00100000:1.0:1789762875.106957:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177536505154 time 177536608471 state 0x0 ref 1 00000100:00100000:1.0:1789762875.106966:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177736608471 time 177536608471 state 0x1 ref 1 00010000:00010000:2.0:1789762875.258938:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762875.299439:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177736608471 time 177736677471 state 0x0 ref 1 00000100:00100000:1.0:1789762875.299466:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246562816:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762875.299514:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 20971520, mtime: 0x6aad9d3b, atime: 0x6aad9d37, ctime: 0x6aad9d3b, blocks: 0xa000 00010000:00010000:1.0:1789762875.299522:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.299552:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=177s v=(0 0) 00010000:00010000:1.0:1789762875.299556:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762875.299561:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.299572:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762875.304528:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967447 is committed 00002000:00010000:2.0:1789762875.304632:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:2.0:1789762875.304638:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 40960 -> 43008 00010000:00010000:2.0:1789762875.304647:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.304655:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.304672:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.304678:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762875.304681:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.304687:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.304701:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.304706:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a2fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762875.304785:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246562816:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5331us (197914us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789762875.304793:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1789762875.304798:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177736608471 time 177736677471 state 0x2 ref 0 00000100:00100000:3.0:1789762875.306879:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762875.306924:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246562944 00000100:00100000:0.0:1789762875.306932:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246562944 00000100:00100000:0.0:1789762875.306962:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177736608471 time 177736677471 state 0x0 ref 1 00000100:00100000:0.0:1789762875.306971:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177936677471 time 177736677471 state 0x1 ref 1 00000100:00100000:1.0:1789762875.499550:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177936677471 time 177936788622 state 0x0 ref 1 00000100:00100000:1.0:1789762875.499578:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246562944:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762875.499627:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 22020096, mtime: 0x6aad9d3b, atime: 0x6aad9d37, ctime: 0x6aad9d3b, blocks: 0xa800 00010000:00010000:1.0:1789762875.499634:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.499649:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=177s v=(0 0) 00010000:00010000:1.0:1789762875.499652:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762875.499657:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.499669:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762875.504712:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967448 is committed 00002000:00010000:1.0:1789762875.504803:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:1.0:1789762875.504808:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 43008 -> 45056 00010000:00010000:1.0:1789762875.504823:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.504832:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.504839:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.504844:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762875.504848:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.504855:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.504868:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.504873:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.504925:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246562944:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5360us (198047us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789762875.504932:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:1.0:1789762875.504937:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177936677471 time 177936788622 state 0x2 ref 0 00000100:00100000:2.0:1789762875.507015:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762875.507110:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563072 00000100:00100000:0.0:1789762875.507118:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563072 00000100:00100000:0.0:1789762875.507151:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 177936677471 time 177936788622 state 0x0 ref 1 00000100:00100000:0.0:1789762875.507160:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178136788622 time 177936788622 state 0x1 ref 1 00000100:00100000:2.0:1789762875.699731:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178136788622 time 178136967251 state 0x0 ref 1 00000100:00100000:2.0:1789762875.699803:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246563072:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762875.699869:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 23068672, mtime: 0x6aad9d3b, atime: 0x6aad9d37, ctime: 0x6aad9d3b, blocks: 0xb000 00010000:00010000:2.0:1789762875.699876:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.699890:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=178s v=(0 0) 00010000:00010000:2.0:1789762875.699893:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762875.699898:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.699911:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762875.705770:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967449 is committed 00002000:00010000:0.0:1789762875.705860:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:0.0:1789762875.705877:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 45056 -> 47104 00010000:00010000:0.0:1789762875.705889:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.705902:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.705912:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.705921:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762875.705926:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.705935:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.705954:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.705963:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a30b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762875.706044:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246563072:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6292us (199028us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789762875.706055:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:0.0:1789762875.706086:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178136788622 time 178136967251 state 0x2 ref 0 00000001:00080000:2.0:1789762875.707717:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000004:00080000:1.0:1789762875.707931:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1789762875.707959:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000004:00080000:1.0:1789762875.707990:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789762875.707994:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1789762875.708088:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762875.708109:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c172a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254912768:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789762875.708139:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c172bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254913024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762875.708149:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254912896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762875.708179:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762875.708211:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762875.708216:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912768 00000100:00100000:2.0:1789762875.708223:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912768 00000100:00100000:0.0:1789762875.708250:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254912896 00000100:00100000:0.0:1789762875.708257:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254912896 00000100:00100000:2.0:1789762875.708271:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789762875.708282:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254912768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789762875.708301:0:12136:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:3.0:1789762875.708302:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789762875.708314:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254912896:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1789762875.708322:0:12136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x4000 00000100:00100000:0.0:1789762875.708330:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762875.708330:0:12136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789762875.708331:0:6912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789762875.708343:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=178s v=(0 0) 00010000:00010000:3.0:1789762875.708346:0:6912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.708348:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762875.708358:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.708363:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254913024 00010000:00010000:3.0:1789762875.708366:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 6 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.708369:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254913024 00010000:00010000:3.0:1789762875.708394:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762875.708403:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1789762875.708410:0:12136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762875.708412:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789762875.708413:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00010000:00010000:3.0:1789762875.708422:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762875.708426:0:6909:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1789762875.708428:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254913024:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789762875.708434:0:12136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762875.708439:0:6909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00002000:00080000:1.0:1789762875.708451:0:7959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6 count 1 00010000:00010000:2.0:1789762875.708452:0:12136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762875.708464:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762875.708470:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x4000 00010000:00010000:2.0:1789762875.708475:0:12136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762875.708478:0:7959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.708494:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=178s v=(0 0) 00010000:00010000:1.0:1789762875.708497:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762875.708501:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.708510:0:7959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.708517:0:7959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.708524:0:7959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.708561:0:7959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789762875.708564:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 6 pid: 6911 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762875.708576:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c172aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6912:1876702254913152:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762875.708631:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3417:x1876702254912768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 350us (453us total) trans 4294967325 rc 0/0 00010000:00010000:0.0:1789762875.708636:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789762875.708641:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:0.0:1789762875.708645:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.708654:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762875.708658:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 6 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.708660:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.708668:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254913024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 244us (340us total) trans 4294967326 rc 0/0 00010000:00010000:2.0:1789762875.708675:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762875.708685:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.708695:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:3.0:1789762875.708695:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 6 pid: 6912 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.708702:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.708711:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762875.708719:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762875.708728:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1728000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6912:1876702254913280:192.168.203.36@tcp:104: 00000004:00080000:1.0:1789762875.708745:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c172bb80/2, rc 0, transno 4294967326 00010000:00010000:0.0:1789762875.708746:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.708771:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.708783:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c172bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254913024:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789762875.708786:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762875.708795:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a312 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.708801:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a320 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762875.708806:0:6912:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f47b50c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789762875.708810:0:3417:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c172a680/2, rc 0, transno 4294967325 00000100:00100000:1.0:1789762875.708818:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c172a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254912768:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789762875.708841:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762875.708845:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762875.708851:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762875.708852:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762875.708852:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1789762875.708856:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762875.708870:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762875.708896:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563200 00000100:00100000:1.0:1789762875.708900:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563200 00000100:00100000:1.0:1789762875.708920:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178136788622 time 178136967251 state 0x0 ref 1 00000100:00100000:1.0:1789762875.708929:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178336967251 time 178136967251 state 0x1 ref 1 00000100:00100000:3.0:1789762875.709731:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c172aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6912:1876702254913152:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762875.709742:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1728000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6912:1876702254913280:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762875.709781:0:6912:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762875.709954:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762875.709972:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762875.709987:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563328 00000100:00100000:2.0:1789762875.709994:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563328 00010000:00010000:2.0:1789762875.710019:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 8 pid: 6912 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762875.710046:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563456 00000100:00100000:2.0:1789762875.710050:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563456 00010000:00010000:2.0:1789762875.710066:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 9 pid: 6911 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.710089:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:1.0:1789762875.710103:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246563328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762875.710113:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762875.710121:0:7992:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 9 pid: 6912 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762875.710127:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00010000:00010000:1.0:1789762875.710143:0:7992:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 9 pid: 6912 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762875.710144:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2354:x1876702246563456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762875.710161:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762875.710168:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 9 pid: 6911 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.710170:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a0b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944664 expref: 9 pid: 6912 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710201:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 9 pid: 6911 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710221:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a0bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894466b expref: 8 pid: 6911 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.710224:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762875.710228:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762875.710234:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762875.710248:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710256:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762875.710267:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762875.710287:0:6912:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.710303:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246563328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 198us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762875.710304:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246563456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 158us (321us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762875.710305:0:6912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762875.710318:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:2.0:1789762875.710328:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00010000:00010000:3.0:1789762875.710330:0:6912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762875.710341:0:6912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762875.710362:0:6912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762875.710374:0:8854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762875.710392:0:8854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710402:0:8854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762875.710406:0:8854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710414:0:8854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710425:0:8854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710432:0:8854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a319 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.710446:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762875.710448:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762875.710450:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762875.710544:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254912896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2231us (2335us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789762875.710552:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000004:00080000:1.0:1789762875.710572:0:3420:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c1724e00/2, rc 0, transno 4294967450 00000100:00100000:1.0:1789762875.710584:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254912896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762875.899886:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178336967251 time 178337121062 state 0x0 ref 1 00000100:00100000:2.0:1789762875.899934:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246563200:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762875.899992:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 24117248, mtime: 0x6aad9d3b, atime: 0x6aad9d37, ctime: 0x6aad9d3b, blocks: 0xb800 00010000:00010000:2.0:1789762875.900003:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.900022:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=178s v=(0 0) 00010000:00010000:2.0:1789762875.900027:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762875.900034:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.900050:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762875.905304:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967451 is committed 00000001:00080000:0.0:1789762875.905313:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967450 is committed 00002000:00010000:2.0:1789762875.905387:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:2.0:1789762875.905393:0:12138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762875 -> 1789762876 00002000:00010000:2.0:1789762875.905396:0:12138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762875 -> 1789762876 00002000:00010000:2.0:1789762875.905399:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 47104 -> 49152 00010000:00010000:2.0:1789762875.905410:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.905423:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.905435:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.905458:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762875.905463:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.905474:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.905493:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762875.905502:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5a327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762875.905568:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246563200:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5646us (196717us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789762875.905580:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:2.0:1789762875.905589:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178336967251 time 178337121062 state 0x2 ref 0 00000100:00100000:3.0:1789762875.907611:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762875.907666:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563584 00000100:00100000:1.0:1789762875.907676:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563584 00000100:00100000:1.0:1789762875.907724:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178336967251 time 178337121062 state 0x0 ref 1 00000100:00100000:1.0:1789762875.907736:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178537121062 time 178337121062 state 0x1 ref 1 00000100:00100000:1.0:1789762876.099996:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178537121062 time 178537233876 state 0x0 ref 1 00000100:00100000:1.0:1789762876.100024:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246563584:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762876.100086:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 25165824, mtime: 0x6aad9d3c, atime: 0x6aad9d37, ctime: 0x6aad9d3c, blocks: 0xc000 00010000:00010000:1.0:1789762876.100097:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.100129:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=178s v=(0 0) 00010000:00010000:1.0:1789762876.100134:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762876.100141:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.100157:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762876.105115:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967452 is committed 00002000:00010000:0.0:1789762876.105201:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:0.0:1789762876.105206:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 49152 -> 51200 00010000:00010000:0.0:1789762876.105216:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.105225:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.105231:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.105236:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762876.105239:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.105247:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.105260:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.105274:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5a32e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762876.105331:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246563584:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5317us (197718us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789762876.105338:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:0.0:1789762876.105344:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178537121062 time 178537233876 state 0x2 ref 0 00000100:00100000:0.0:1789762876.107745:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762876.107799:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563712 00000100:00100000:2.0:1789762876.107806:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563712 00000100:00100000:2.0:1789762876.107841:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178537121062 time 178537233876 state 0x0 ref 1 00000100:00100000:2.0:1789762876.107850:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178737233876 time 178537233876 state 0x1 ref 1 00000004:00080000:0.0:1789762876.218944:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 178656190122ns, next at 179656187330ns, rc = 0 00000100:00100000:1.0:1789762876.218953:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762876.219017:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762876.219079:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254913408 00000100:00100000:0.0:1789762876.219090:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254913408 00000100:00080000:2.0:1789762876.219127:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762876.219149:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789762876.219157:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254913408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762876.219176:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3883823104 avail 3649081344 00000100:00100000:0.0:1789762876.219219:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762876.219225:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789762876.219250:0:3417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967450 gen 2 00000004:00080000:1.0:1789762876.219255:0:3417:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c1724e00, transno 4294967450 00000100:00100000:1.0:1789762876.219272:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254913408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762876.282916:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762876.300087:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178737233876 time 178737327586 state 0x0 ref 1 00000100:00100000:0.0:1789762876.300113:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246563712:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762876.300167:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 26214400, mtime: 0x6aad9d3c, atime: 0x6aad9d37, ctime: 0x6aad9d3c, blocks: 0xc800 00010000:00010000:0.0:1789762876.300175:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.300220:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=178s v=(0 0) 00010000:00010000:0.0:1789762876.300224:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762876.300229:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.300241:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762876.305227:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967453 is committed 00002000:00010000:1.0:1789762876.305309:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:1.0:1789762876.305315:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 51200 -> 53248 00010000:00010000:1.0:1789762876.305326:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.305339:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.305349:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.305363:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762876.305367:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.305374:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.305387:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.305392:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a335 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.305445:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246563712:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5340us (197699us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789762876.305455:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:1.0:1789762876.305462:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178737233876 time 178737327586 state 0x2 ref 0 00000100:00100000:3.0:1789762876.307869:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762876.307911:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563840 00000100:00100000:2.0:1789762876.307925:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563840 00000100:00100000:2.0:1789762876.307958:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178737233876 time 178737327586 state 0x0 ref 1 00000100:00100000:2.0:1789762876.307968:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178937327586 time 178737327586 state 0x1 ref 1 00000100:00100000:1.0:1789762876.500236:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178937327586 time 178937472974 state 0x0 ref 1 00000100:00100000:1.0:1789762876.500265:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246563840:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762876.500315:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 27262976, mtime: 0x6aad9d3c, atime: 0x6aad9d37, ctime: 0x6aad9d3c, blocks: 0xd000 00010000:00010000:1.0:1789762876.500324:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.500357:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=178s v=(0 0) 00010000:00010000:1.0:1789762876.500361:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762876.500366:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.500377:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762876.505615:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967454 is committed 00002000:00010000:1.0:1789762876.505692:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:1.0:1789762876.505697:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 53248 -> 55296 00010000:00010000:1.0:1789762876.505705:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.505714:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.505720:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.505725:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762876.505728:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.505735:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.505773:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.505779:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a33c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.505831:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246563840:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5579us (197962us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789762876.505838:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1789762876.505844:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178937327586 time 178937472974 state 0x2 ref 0 00000100:00100000:2.0:1789762876.508144:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762876.508197:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246563968 00000100:00100000:0.0:1789762876.508206:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246563968 00000100:00100000:0.0:1789762876.508240:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 178937327586 time 178937472974 state 0x0 ref 1 00000100:00100000:0.0:1789762876.508252:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179137472974 time 178937472974 state 0x1 ref 1 00000100:00100000:1.0:1789762876.700328:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179137472974 time 179137565791 state 0x0 ref 1 00000100:00100000:1.0:1789762876.700354:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246563968:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762876.700401:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 28311552, mtime: 0x6aad9d3c, atime: 0x6aad9d37, ctime: 0x6aad9d3c, blocks: 0xd800 00010000:00010000:1.0:1789762876.700409:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.700422:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=179s v=(0 0) 00010000:00010000:1.0:1789762876.700426:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762876.700430:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.700442:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762876.705867:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967455 is committed 00002000:00010000:1.0:1789762876.705938:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:1.0:1789762876.705943:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 55296 -> 57344 00010000:00010000:1.0:1789762876.705952:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.705961:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.705967:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.705972:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762876.705975:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.705982:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.705995:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762876.706000:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762876.706054:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246563968:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5711us (197911us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789762876.706081:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:1.0:1789762876.706087:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179137472974 time 179137565791 state 0x2 ref 0 00000100:00100000:3.0:1789762876.708200:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762876.708234:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564096 00000100:00100000:1.0:1789762876.708242:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564096 00000100:00100000:1.0:1789762876.708272:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179137472974 time 179137565791 state 0x0 ref 1 00000100:00100000:1.0:1789762876.708280:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179337565791 time 179137565791 state 0x1 ref 1 00000100:00100000:0.0:1789762876.900450:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179337565791 time 179337688007 state 0x0 ref 1 00000100:00100000:0.0:1789762876.900479:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564096:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762876.900527:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 29360128, mtime: 0x6aad9d3c, atime: 0x6aad9d37, ctime: 0x6aad9d3c, blocks: 0xe000 00010000:00010000:0.0:1789762876.900535:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.900548:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=179s v=(0 0) 00010000:00010000:0.0:1789762876.900552:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762876.900556:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.900585:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762876.906034:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967456 is committed 00002000:00010000:0.0:1789762876.906128:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:0.0:1789762876.906132:0:6916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762876 -> 1789762877 00002000:00010000:0.0:1789762876.906134:0:6916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762876 -> 1789762877 00002000:00010000:0.0:1789762876.906136:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 57344 -> 59392 00010000:00010000:0.0:1789762876.906147:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.906157:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.906164:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.906169:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762876.906172:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.906179:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.906193:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762876.906208:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a34a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762876.906266:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564096:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5799us (198065us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789762876.906275:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1789762876.906284:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179337565791 time 179337688007 state 0x2 ref 0 00000100:00100000:2.0:1789762876.908600:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762876.908659:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564224 00000100:00100000:1.0:1789762876.908667:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564224 00000100:00100000:1.0:1789762876.908704:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179337565791 time 179337688007 state 0x0 ref 1 00000100:00100000:1.0:1789762876.908713:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179537688007 time 179337688007 state 0x1 ref 1 00000100:00100000:2.0:1789762877.100622:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179537688007 time 179537857342 state 0x0 ref 1 00000100:00100000:2.0:1789762877.100675:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564224:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:3.0:1789762877.100704:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762877.100736:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 30408704, mtime: 0x6aad9d3d, atime: 0x6aad9d37, ctime: 0x6aad9d3d, blocks: 0xe800 00010000:00010000:2.0:1789762877.100747:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.100792:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=179s v=(0 0) 00010000:00010000:2.0:1789762877.100797:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762877.100804:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.100819:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762877.106744:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967457 is committed 00002000:00010000:0.0:1789762877.106839:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:0.0:1789762877.106845:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 59392 -> 61440 00010000:00010000:0.0:1789762877.106854:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.106864:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.106870:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.106875:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762877.106879:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.106886:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.106913:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.106919:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a351 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762877.106976:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564224:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6334us (198375us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789762877.106987:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1789762877.106994:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179537688007 time 179537857342 state 0x2 ref 0 00000100:00100000:3.0:1789762877.109726:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762877.109799:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564352 00000100:00100000:1.0:1789762877.109809:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564352 00000100:00100000:1.0:1789762877.109844:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179537688007 time 179537857342 state 0x0 ref 1 00000100:00100000:1.0:1789762877.109853:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179737857342 time 179537857342 state 0x1 ref 1 00000100:00100000:2.0:1789762877.300811:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179737857342 time 179738048616 state 0x0 ref 1 00000100:00100000:2.0:1789762877.300840:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564352:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762877.300890:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 31457280, mtime: 0x6aad9d3d, atime: 0x6aad9d37, ctime: 0x6aad9d3d, blocks: 0xf000 00010000:00010000:2.0:1789762877.300897:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.300924:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=179s v=(0 0) 00010000:00010000:2.0:1789762877.300928:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762877.300932:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.300944:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762877.306694:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967458 is committed 00002000:00010000:2.0:1789762877.306801:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:2.0:1789762877.306806:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 61440 -> 63488 00010000:00010000:2.0:1789762877.306816:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.306825:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.306833:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.306839:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762877.306844:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.306851:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762877.306861:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762877.306881:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762877.306888:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762877.306963:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564352:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6136us (197239us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789762877.306971:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:2.0:1789762877.306976:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179737857342 time 179738048616 state 0x2 ref 0 00000100:00100000:0.0:1789762877.309046:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762877.309097:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564480 00000100:00100000:3.0:1789762877.309104:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564480 00000100:00100000:3.0:1789762877.309133:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179737857342 time 179738048616 state 0x0 ref 1 00000100:00100000:3.0:1789762877.309141:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179938048616 time 179738048616 state 0x1 ref 1 00000100:00100000:0.0:1789762877.500910:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179938048616 time 179938148361 state 0x0 ref 1 00000100:00100000:0.0:1789762877.500938:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564480:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762877.500985:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 32505856, mtime: 0x6aad9d3d, atime: 0x6aad9d37, ctime: 0x6aad9d3d, blocks: 0xf800 00010000:00010000:0.0:1789762877.500993:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.501008:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=179s v=(0 0) 00010000:00010000:0.0:1789762877.501011:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762877.501016:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.501027:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762877.506899:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967459 is committed 00002000:00010000:1.0:1789762877.506964:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:1.0:1789762877.506970:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 63488 -> 65536 00010000:00010000:1.0:1789762877.506979:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.506987:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.506993:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.507006:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762877.507009:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.507016:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.507028:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.507033:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a35f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762877.507110:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564480:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6185us (198064us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789762877.507116:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:1.0:1789762877.507121:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179938048616 time 179938148361 state 0x2 ref 0 00000100:00100000:0.0:1789762877.509264:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762877.509316:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564608 00000100:00100000:2.0:1789762877.509324:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564608 00000100:00100000:2.0:1789762877.509357:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 179938048616 time 179938148361 state 0x0 ref 1 00000100:00100000:2.0:1789762877.509366:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180138148361 time 179938148361 state 0x1 ref 1 00000100:00100000:0.0:1789762877.701023:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180138148361 time 180138261216 state 0x0 ref 1 00000100:00100000:0.0:1789762877.701053:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564608:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762877.701112:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 33554432, mtime: 0x6aad9d3d, atime: 0x6aad9d37, ctime: 0x6aad9d3d, blocks: 0x10000 00010000:00010000:0.0:1789762877.701119:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.701133:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=180s v=(0 0) 00010000:00010000:0.0:1789762877.701137:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762877.701142:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762877.701155:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762877.706708:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967460 is committed 00002000:00010000:1.0:1789762877.706826:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:1.0:1789762877.706831:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 65536 -> 67584 00010000:00010000:1.0:1789762877.706839:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.706848:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.706866:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.706871:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762877.706875:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.706881:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.706895:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.706900:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a366 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762877.706960:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564608:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5921us (197696us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789762877.706966:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:1.0:1789762877.706974:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180138148361 time 180138261216 state 0x2 ref 0 00000100:00100000:3.0:1789762877.709085:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762877.709140:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564736 00000100:00100000:2.0:1789762877.709154:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564736 00000100:00100000:2.0:1789762877.709213:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180138148361 time 180138261216 state 0x0 ref 1 00000100:00100000:2.0:1789762877.709226:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180338261216 time 180138261216 state 0x1 ref 1 00000100:00100000:1.0:1789762877.901134:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180338261216 time 180338368106 state 0x0 ref 1 00000100:00100000:1.0:1789762877.901173:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564736:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762877.901238:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 34603008, mtime: 0x6aad9d3d, atime: 0x6aad9d37, ctime: 0x6aad9d3d, blocks: 0x10800 00010000:00010000:1.0:1789762877.901265:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.901282:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=180s v=(0 0) 00010000:00010000:1.0:1789762877.901286:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762877.901293:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.901308:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762877.907148:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967461 is committed 00002000:00010000:1.0:1789762877.907232:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:1.0:1789762877.907237:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762877 -> 1789762878 00002000:00010000:1.0:1789762877.907239:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762877 -> 1789762878 00002000:00010000:1.0:1789762877.907241:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 67584 -> 69632 00010000:00010000:1.0:1789762877.907251:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.907260:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.907268:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.907273:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762877.907277:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.907295:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.907311:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762877.907317:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a36d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762877.907380:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564736:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6228us (198298us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789762877.907387:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:1.0:1789762877.907394:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180338261216 time 180338368106 state 0x2 ref 0 00000100:00100000:3.0:1789762877.909591:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762877.909661:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564864 00000100:00100000:1.0:1789762877.909670:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564864 00000100:00100000:1.0:1789762877.909709:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180338261216 time 180338368106 state 0x0 ref 1 00000100:00100000:1.0:1789762877.909720:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180538368106 time 180338368106 state 0x1 ref 1 00000100:00100000:1.0:1789762878.101227:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180538368106 time 180538462428 state 0x0 ref 1 00000100:00100000:1.0:1789762878.101267:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564864:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762878.101334:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 35651584, mtime: 0x6aad9d3e, atime: 0x6aad9d37, ctime: 0x6aad9d3e, blocks: 0x11000 00010000:00010000:1.0:1789762878.101343:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.101382:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=180s v=(0 0) 00010000:00010000:1.0:1789762878.101387:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762878.101392:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.101406:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.107093:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967462 is committed 00002000:00010000:1.0:1789762878.107178:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:1.0:1789762878.107184:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 69632 -> 71680 00010000:00010000:1.0:1789762878.107195:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.107203:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.107211:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.107216:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762878.107220:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.107228:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.107257:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.107263:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762878.107327:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246564864:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6082us (197737us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789762878.107334:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:1.0:1789762878.107339:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180538368106 time 180538462428 state 0x2 ref 0 00000100:00100000:3.0:1789762878.109510:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762878.109581:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246564992 00000100:00100000:1.0:1789762878.109591:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246564992 00000100:00100000:1.0:1789762878.109629:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180538368106 time 180538462428 state 0x0 ref 1 00000100:00100000:1.0:1789762878.109640:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180738462428 time 180538462428 state 0x1 ref 1 00000100:00100000:3.0:1789762878.301358:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180738462428 time 180738595771 state 0x0 ref 1 00000100:00100000:3.0:1789762878.301387:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564992:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762878.301437:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 36700160, mtime: 0x6aad9d3e, atime: 0x6aad9d37, ctime: 0x6aad9d3e, blocks: 0x11800 00010000:00010000:3.0:1789762878.301452:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.301465:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=180s v=(0 0) 00010000:00010000:3.0:1789762878.301469:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762878.301474:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762878.301502:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.308210:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967463 is committed 00002000:00010000:1.0:1789762878.308297:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:1.0:1789762878.308304:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 71680 -> 73728 00010000:00010000:1.0:1789762878.308315:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.308327:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.308338:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.308357:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762878.308361:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.308369:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.308382:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.308388:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a37b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762878.308461:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246564992:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7088us (198955us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789762878.308476:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1789762878.308483:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180738462428 time 180738595771 state 0x2 ref 0 00000100:00100000:0.0:1789762878.310780:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762878.310812:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246565120 00000100:00100000:1.0:1789762878.310820:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246565120 00000100:00100000:1.0:1789762878.310848:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180738462428 time 180738595771 state 0x0 ref 1 00000100:00100000:1.0:1789762878.310857:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180938595771 time 180738595771 state 0x1 ref 1 00010000:00010000:2.0:1789762878.330921:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762878.501514:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180938595771 time 180938748304 state 0x0 ref 1 00000100:00100000:2.0:1789762878.501554:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565120:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762878.501643:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 37748736, mtime: 0x6aad9d3e, atime: 0x6aad9d37, ctime: 0x6aad9d3e, blocks: 0x12000 00010000:00010000:2.0:1789762878.501653:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.501670:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=180s v=(0 0) 00010000:00010000:2.0:1789762878.501673:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762878.501679:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.501702:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.507562:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967464 is committed 00002000:00010000:2.0:1789762878.507641:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:2.0:1789762878.507646:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 73728 -> 75776 00010000:00010000:2.0:1789762878.507656:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.507665:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.507673:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.507678:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762878.507683:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.507701:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.507717:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.507723:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762878.507818:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565120:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6283us (197037us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1789762878.507826:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:2.0:1789762878.507833:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180938595771 time 180938748304 state 0x2 ref 0 00000100:00100000:0.0:1789762878.510168:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762878.510232:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246565248 00000100:00100000:1.0:1789762878.510241:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246565248 00000100:00100000:1.0:1789762878.510287:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 180938595771 time 180938748304 state 0x0 ref 1 00000100:00100000:1.0:1789762878.510309:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181138748304 time 180938748304 state 0x1 ref 1 00000100:00100000:2.0:1789762878.701663:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181138748304 time 181138896983 state 0x0 ref 1 00000100:00100000:2.0:1789762878.701705:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246565248:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762878.701824:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 38797312, mtime: 0x6aad9d3e, atime: 0x6aad9d37, ctime: 0x6aad9d3e, blocks: 0x12800 00010000:00010000:2.0:1789762878.701833:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.701852:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=181s v=(0 0) 00010000:00010000:2.0:1789762878.701857:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762878.701863:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.701902:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.707358:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967465 is committed 00002000:00010000:2.0:1789762878.707465:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:2.0:1789762878.707471:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 75776 -> 77824 00010000:00010000:2.0:1789762878.707481:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.707490:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.707497:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.707503:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762878.707507:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.707514:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.707530:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762878.707535:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762878.707609:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246565248:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5928us (197445us total) trans 4294967465 rc 0/0 00000100:00100000:2.0:1789762878.707617:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:2.0:1789762878.707623:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181138748304 time 181138896983 state 0x2 ref 0 00000100:00100000:3.0:1789762878.709931:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762878.710006:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246565376 00000100:00100000:1.0:1789762878.710020:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246565376 00000100:00100000:1.0:1789762878.710091:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181138748304 time 181138896983 state 0x0 ref 1 00000100:00100000:1.0:1789762878.710105:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181338896983 time 181138896983 state 0x1 ref 1 00000100:00100000:0.0:1789762878.901812:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181338896983 time 181339050074 state 0x0 ref 1 00000100:00100000:0.0:1789762878.901841:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565376:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762878.901889:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 39845888, mtime: 0x6aad9d3e, atime: 0x6aad9d37, ctime: 0x6aad9d3e, blocks: 0x13000 00010000:00010000:0.0:1789762878.901896:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.901925:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=181s v=(0 0) 00010000:00010000:0.0:1789762878.901929:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762878.901934:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762878.901946:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762878.907189:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967466 is committed 00002000:00010000:1.0:1789762878.907268:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:1.0:1789762878.907273:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762878 -> 1789762879 00002000:00010000:1.0:1789762878.907275:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762878 -> 1789762879 00002000:00010000:1.0:1789762878.907278:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 77824 -> 79872 00010000:00010000:1.0:1789762878.907288:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.907300:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.907310:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.907319:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762878.907324:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.907334:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.907361:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762878.907366:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a390 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762878.907426:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565376:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5595us (197492us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1789762878.907432:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:1.0:1789762878.907438:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181338896983 time 181339050074 state 0x2 ref 0 00000100:00100000:3.0:1789762878.909774:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762878.909832:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246565504 00000100:00100000:2.0:1789762878.909846:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246565504 00000100:00100000:2.0:1789762878.909899:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181338896983 time 181339050074 state 0x0 ref 1 00000100:00100000:2.0:1789762878.909911:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181539050074 time 181339050074 state 0x1 ref 1 00000100:00100000:0.0:1789762879.101986:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181539050074 time 181539224036 state 0x0 ref 1 00000100:00100000:0.0:1789762879.102033:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246565504:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:3.0:1789762879.102089:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762879.102096:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 40894464, mtime: 0x6aad9d3f, atime: 0x6aad9d37, ctime: 0x6aad9d3f, blocks: 0x13800 00010000:00010000:0.0:1789762879.102105:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.102120:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=181s v=(0 0) 00010000:00010000:0.0:1789762879.102124:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762879.102130:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.102141:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.107543:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967467 is committed 00002000:00010000:1.0:1789762879.107604:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:1.0:1789762879.107611:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 79872 -> 81920 00010000:00010000:1.0:1789762879.107622:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.107634:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.107644:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.107653:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762879.107659:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.107678:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.107693:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.107698:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035e5a0cd/0x5915dfb1c1b5a397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762879.107768:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246565504:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5749us (198002us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789762879.107775:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:1.0:1789762879.107780:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181539050074 time 181539224036 state 0x2 ref 0 00000100:00100000:3.0:1789762879.109806:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762879.109918:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246565632 00000100:00100000:2.0:1789762879.109933:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246565632 00000100:00100000:2.0:1789762879.109992:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181539050074 time 181539224036 state 0x0 ref 1 00000100:00100000:2.0:1789762879.110005:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181739224036 time 181539224036 state 0x1 ref 1 00000100:00100000:0.0:1789762879.290980:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254913536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762879.291016:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254913920:0@lo:400:kworker.0 00000100:00100000:0.0:1789762879.291074:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762879.291106:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762879.291115:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254913792:0@lo:400:kworker.0 00000100:00100000:1.0:1789762879.291142:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254913536 00000100:00100000:1.0:1789762879.291153:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254913536 00000100:00100000:3.0:1789762879.291162:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789762879.291165:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254914176:0@lo:400:kworker.0 00000100:00100000:3.0:1789762879.291176:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254913664:0@lo:400:kworker.0 00000100:00100000:2.0:1789762879.291201:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762879.291232:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762879.291234:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789762879.291241:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762879.291253:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254913536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762879.291283:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254914304:0@lo:400:kworker.0 00000100:00100000:0.0:1789762879.291284:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254913664 00002000:00000024:1.0:1789762879.291284:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42320448 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762879.291295:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254914048:0@lo:400:kworker.0 00000100:00100000:0.0:1789762879.291297:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254913664 00000100:00100000:0.0:1789762879.291351:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789762879.291359:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254913536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762879.291361:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254913664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762879.291376:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789762879.291391:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762879.291396:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254913920 00000100:00100000:3.0:1789762879.291400:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254913920 00000100:00100000:1.0:1789762879.291433:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254913792 00000100:00100000:0.0:1789762879.291435:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254913664:12345-0@lo:400:kworker.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762879.291439:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254913792 00000100:00100000:0.0:1789762879.291445:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789762879.291461:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789762879.291471:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254913920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762879.291500:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914304 00000100:00100000:1.0:1789762879.291512:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789762879.291512:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914304 00000100:00100000:0.0:1789762879.291514:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762879.291515:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254913920:12345-0@lo:400:kworker.0 Request processed in 47us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762879.291531:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254913792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762879.291538:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789762879.291580:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254913920:0@lo:400:kworker.0 00000100:00080000:3.0:1789762879.291580:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762879.291594:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914048 00000100:00100000:2.0:1789762879.291602:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914048 00000100:00100000:1.0:1789762879.291607:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254913792:12345-0@lo:400:kworker.0 Request processed in 70us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762879.291617:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789762879.291621:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254913664:0@lo:400:kworker.0 00000100:00100000:3.0:1789762879.291634:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254913792:0@lo:400:kworker.0 00000100:00100000:2.0:1789762879.291681:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789762879.291681:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762879.291693:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762879.291702:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789762879.291712:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3420:x1876702254914304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762879.291719:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254914048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762879.291739:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914176 00000100:00100000:3.0:1789762879.291746:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914176 00000100:00100000:1.0:1789762879.291798:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254913536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762879.291810:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254914048:12345-0@lo:400:kworker.0 Request processed in 98us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762879.291817:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762879.291854:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789762879.291882:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3420:x1876702254914304:12345-0@lo:400:kworker.0 Request processed in 167us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762879.291883:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254914176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762879.291884:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254914048:0@lo:400:kworker.0 00000100:00100000:2.0:1789762879.291920:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789762879.291966:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254914176:12345-0@lo:400:kworker.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762879.291974:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254914304:0@lo:400:kworker.0 00000100:00100000:3.0:1789762879.291983:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789762879.292019:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254914176:0@lo:400:kworker.0 00000100:00080000:2.0:1789762879.292032:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762879.302094:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181739224036 time 181739334841 state 0x0 ref 1 00000100:00100000:3.0:1789762879.302113:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565632:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762879.302150:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 41943040, mtime: 0x6aad9d3f, atime: 0x6aad9d37, ctime: 0x6aad9d3f, blocks: 0x14000 00010000:00010000:3.0:1789762879.302157:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762879.302171:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=181s v=(0 0) 00010000:00010000:3.0:1789762879.302175:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762879.302180:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762879.302191:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.307151:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967468 is committed 00002000:00010000:1.0:1789762879.307226:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:1.0:1789762879.307232:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 81920 -> 83968 00010000:00010000:1.0:1789762879.307240:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.307249:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.307255:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.307260:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762879.307264:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.307271:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.307284:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.307299:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5dbb257/0x5915dfb1c1b5a39e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762879.307347:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565632:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5240us (197541us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789762879.307354:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1789762879.307358:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181739224036 time 181739334841 state 0x2 ref 0 00000100:00100000:3.0:1789762879.309833:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762879.309871:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246565760 00000100:00100000:1.0:1789762879.309877:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246565760 00000100:00100000:1.0:1789762879.309905:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181739224036 time 181739334841 state 0x0 ref 1 00000100:00100000:1.0:1789762879.309914:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181939334841 time 181739334841 state 0x1 ref 1 00010000:00010000:2.0:1789762879.354947:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762879.502179:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181939334841 time 181939416018 state 0x0 ref 1 00000100:00100000:1.0:1789762879.502214:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246565760:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762879.502273:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 42991616, mtime: 0x6aad9d3f, atime: 0x6aad9d37, ctime: 0x6aad9d3f, blocks: 0x14800 00010000:00010000:1.0:1789762879.502281:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.502294:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=181s v=(0 0) 00010000:00010000:1.0:1789762879.502298:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762879.502302:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.502330:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.507383:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967469 is committed 00002000:00010000:1.0:1789762879.507449:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:1.0:1789762879.507454:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 83968 -> 86016 00010000:00010000:1.0:1789762879.507462:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.507469:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.507475:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.507480:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762879.507483:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.507490:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.507503:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.507508:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762879.507574:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246565760:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5374us (197739us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789762879.507582:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:1.0:1789762879.507587:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181939334841 time 181939416018 state 0x2 ref 0 00000100:00100000:0.0:1789762879.509691:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762879.509727:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246565888 00000100:00100000:1.0:1789762879.509734:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246565888 00000100:00100000:1.0:1789762879.509778:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 181939334841 time 181939416018 state 0x0 ref 1 00000100:00100000:1.0:1789762879.509787:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182139416018 time 181939416018 state 0x1 ref 1 00000100:00100000:1.0:1789762879.702273:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182139416018 time 182139511988 state 0x0 ref 1 00000100:00100000:1.0:1789762879.702301:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565888:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762879.702349:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 44040192, mtime: 0x6aad9d3f, atime: 0x6aad9d37, ctime: 0x6aad9d3f, blocks: 0x15000 00010000:00010000:1.0:1789762879.702356:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.702369:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=182s v=(0 0) 00010000:00010000:1.0:1789762879.702372:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762879.702377:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.702390:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.707207:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967470 is committed 00002000:00010000:1.0:1789762879.707285:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:1.0:1789762879.707291:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 86016 -> 88064 00010000:00010000:1.0:1789762879.707302:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.707314:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.707321:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.707327:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762879.707330:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.707337:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.707350:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762879.707355:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762879.707413:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246565888:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5121us (197718us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789762879.707431:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:1.0:1789762879.707437:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182139416018 time 182139511988 state 0x2 ref 0 00000100:00100000:3.0:1789762879.709532:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762879.709573:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566016 00000100:00100000:1.0:1789762879.709582:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566016 00000100:00100000:1.0:1789762879.709616:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182139416018 time 182139511988 state 0x0 ref 1 00000100:00100000:1.0:1789762879.709623:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182339511988 time 182139511988 state 0x1 ref 1 00000100:00100000:0.0:1789762879.875673:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762879.875711:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762879.875729:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566272 00000100:00100000:0.0:1789762879.875738:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762879.875740:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566272 00000100:00100000:2.0:1789762879.875788:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566144 00000100:00100000:2.0:1789762879.875796:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566144 00000100:00100000:1.0:1789762879.875797:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566528 00000100:00100000:1.0:1789762879.875805:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566528 00000100:00100000:0.0:1789762879.875820:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762879.875841:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:2.0:1789762879.875849:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 245 00000100:00100000:1.0:1789762879.875855:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:3.0:1789762879.875858:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246566272:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762879.875863:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246566144:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762879.875870:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566400 00000100:00100000:1.0:1789762879.875872:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246566528:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762879.875875:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566400 00000100:00100000:0.0:1789762879.875924:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:2.0:1789762879.875932:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246566144:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762879.875933:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246566272:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 77us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762879.875934:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246566528:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762879.875940:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246566400:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762879.875953:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 245 00000100:00100000:1.0:1789762879.875958:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:3.0:1789762879.875966:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:0.0:1789762879.875980:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246566400:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762879.875990:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00080000:2.0:1789762879.876001:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789762879.876007:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762879.902371:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182339511988 time 182339609699 state 0x0 ref 1 00000100:00100000:2.0:1789762879.902406:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246566016:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762879.902456:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 45088768, mtime: 0x6aad9d3f, atime: 0x6aad9d37, ctime: 0x6aad9d3f, blocks: 0x15800 00010000:00010000:2.0:1789762879.902463:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.902477:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=182s v=(0 0) 00010000:00010000:2.0:1789762879.902481:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762879.902486:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762879.902513:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762879.907523:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967471 is committed 00002000:00010000:0.0:1789762879.907606:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1789762879.907610:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762879 -> 1789762880 00002000:00010000:0.0:1789762879.907612:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762879 -> 1789762880 00002000:00010000:0.0:1789762879.907614:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 88064 -> 90112 00010000:00010000:0.0:1789762879.907623:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.907631:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.907638:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.907643:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762879.907646:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.907652:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.907665:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762879.907677:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a3b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762879.907729:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246566016:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5342us (198198us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789762879.907736:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:0.0:1789762879.907742:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182339511988 time 182339609699 state 0x2 ref 0 00000100:00100000:3.0:1789762879.909967:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762879.910027:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566656 00000100:00100000:1.0:1789762879.910037:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566656 00000100:00100000:1.0:1789762879.910090:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182339511988 time 182339609699 state 0x0 ref 1 00000100:00100000:1.0:1789762879.910101:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182539609699 time 182339609699 state 0x1 ref 1 00000100:00100000:2.0:1789762880.102514:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182539609699 time 182539751509 state 0x0 ref 1 00000100:00100000:2.0:1789762880.102543:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246566656:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762880.102595:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 46137344, mtime: 0x6aad9d40, atime: 0x6aad9d37, ctime: 0x6aad9d40, blocks: 0x16000 00010000:00010000:2.0:1789762880.102602:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.102616:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=182s v=(0 0) 00010000:00010000:2.0:1789762880.102619:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762880.102623:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762880.102645:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.108555:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967472 is committed 00002000:00010000:0.0:1789762880.108635:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:0.0:1789762880.108640:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 90112 -> 92160 00010000:00010000:0.0:1789762880.108650:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.108660:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.108666:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.108671:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762880.108675:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.108682:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.108707:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.108713:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5a3ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762880.108790:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246566656:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6259us (198822us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789762880.108799:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:0.0:1789762880.108806:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182539609699 time 182539751509 state 0x2 ref 0 00000100:00100000:3.0:1789762880.111193:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762880.111244:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566784 00000100:00100000:1.0:1789762880.111254:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566784 00000100:00100000:1.0:1789762880.111308:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182539609699 time 182539751509 state 0x0 ref 1 00000100:00100000:1.0:1789762880.111317:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182739751509 time 182539751509 state 0x1 ref 1 00000100:00100000:0.0:1789762880.302671:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182739751509 time 182739909998 state 0x0 ref 1 00000100:00100000:0.0:1789762880.302700:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246566784:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762880.302748:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 47185920, mtime: 0x6aad9d40, atime: 0x6aad9d37, ctime: 0x6aad9d40, blocks: 0x16800 00010000:00010000:0.0:1789762880.302796:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.302810:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=182s v=(0 0) 00010000:00010000:0.0:1789762880.302814:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762880.302819:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.302830:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.308229:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967473 is committed 00002000:00010000:0.0:1789762880.308303:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:0.0:1789762880.308309:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 92160 -> 94208 00010000:00010000:0.0:1789762880.308319:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.308332:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.308342:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.308350:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762880.308355:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.308365:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.308383:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.308391:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762880.308453:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246566784:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5765us (197260us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789762880.308465:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:0.0:1789762880.308470:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182739751509 time 182739909998 state 0x2 ref 0 00000100:00100000:2.0:1789762880.310623:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762880.310669:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246566912 00000100:00100000:0.0:1789762880.310676:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246566912 00000100:00100000:0.0:1789762880.310713:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182739751509 time 182739909998 state 0x0 ref 1 00000100:00100000:0.0:1789762880.310721:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182939909998 time 182739909998 state 0x1 ref 1 00010000:00010000:2.0:1789762880.378920:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762880.502811:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182939909998 time 182940047141 state 0x0 ref 1 00000100:00100000:0.0:1789762880.502848:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246566912:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762880.502905:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 48234496, mtime: 0x6aad9d40, atime: 0x6aad9d37, ctime: 0x6aad9d40, blocks: 0x17000 00010000:00010000:0.0:1789762880.502915:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.502932:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=182s v=(0 0) 00010000:00010000:0.0:1789762880.502936:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762880.502942:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.502957:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.508266:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967474 is committed 00002000:00010000:0.0:1789762880.508338:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:0.0:1789762880.508343:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 94208 -> 96256 00010000:00010000:0.0:1789762880.508354:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.508372:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.508382:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.508389:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762880.508392:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.508399:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.508411:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762880.508417:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a3c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762880.508468:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246566912:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5637us (197851us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789762880.508475:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:0.0:1789762880.508480:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182939909998 time 182940047141 state 0x2 ref 0 00000100:00100000:3.0:1789762880.510568:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762880.510611:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567040 00000100:00100000:0.0:1789762880.510625:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567040 00000100:00100000:0.0:1789762880.510664:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 182939909998 time 182940047141 state 0x0 ref 1 00000100:00100000:0.0:1789762880.510674:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183140047141 time 182940047141 state 0x1 ref 1 00000100:00100000:3.0:1789762880.702992:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183140047141 time 183140230208 state 0x0 ref 1 00000100:00100000:3.0:1789762880.703027:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567040:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762880.704146:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 49283072, mtime: 0x6aad9d40, atime: 0x6aad9d37, ctime: 0x6aad9d40, blocks: 0x17800 00010000:00010000:3.0:1789762880.704156:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.704171:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=183s v=(0 0) 00010000:00010000:3.0:1789762880.704174:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762880.704179:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762880.704206:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.713324:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967475 is committed 00002000:00010000:1.0:1789762880.713439:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:1.0:1789762880.713456:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 96256 -> 98304 00010000:00010000:1.0:1789762880.713470:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.713480:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.713487:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.713493:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762880.713497:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.713507:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.713530:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.713539:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8684b3a/0x5915dfb1c1b5a3cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.713628:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567040:12345-192.168.203.36@tcp:4:dd.500 Request processed in 10617us (203056us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789762880.713639:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:1.0:1789762880.713647:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183140047141 time 183140230208 state 0x2 ref 0 00000100:00100000:2.0:1789762880.715819:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762880.715905:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567168 00000100:00100000:0.0:1789762880.715915:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567168 00000100:00100000:0.0:1789762880.715955:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183140047141 time 183140230208 state 0x0 ref 1 00000100:00100000:0.0:1789762880.715965:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183340230208 time 183140230208 state 0x1 ref 1 00000100:00100000:1.0:1789762880.903106:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183340230208 time 183340340213 state 0x0 ref 1 00000100:00100000:1.0:1789762880.903140:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246567168:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762880.903205:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 50331648, mtime: 0x6aad9d40, atime: 0x6aad9d37, ctime: 0x6aad9d40, blocks: 0x18000 00010000:00010000:1.0:1789762880.903214:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.903232:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=183s v=(0 0) 00010000:00010000:1.0:1789762880.903236:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762880.903241:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.903255:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762880.908941:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967476 is committed 00002000:00010000:1.0:1789762880.909065:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:1.0:1789762880.909070:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762880 -> 1789762881 00002000:00010000:1.0:1789762880.909072:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762880 -> 1789762881 00002000:00010000:1.0:1789762880.909074:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 98304 -> 100352 00010000:00010000:1.0:1789762880.909084:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.909093:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.909100:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.909113:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762880.909117:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.909125:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.909142:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762880.909147:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762880.909209:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246567168:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6085us (193392us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789762880.909217:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:1.0:1789762880.909223:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183340230208 time 183340340213 state 0x2 ref 0 00000100:00100000:0.0:1789762880.911203:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762880.911239:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567296 00000100:00100000:1.0:1789762880.911248:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567296 00000100:00100000:1.0:1789762880.911287:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183340230208 time 183340340213 state 0x0 ref 1 00000100:00100000:1.0:1789762880.911298:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183540340213 time 183340340213 state 0x1 ref 1 00000100:00100000:1.0:1789762881.103201:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183540340213 time 183540435226 state 0x0 ref 1 00000100:00100000:1.0:1789762881.103257:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567296:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:2.0:1789762881.103323:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789762881.103347:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 51380224, mtime: 0x6aad9d41, atime: 0x6aad9d37, ctime: 0x6aad9d41, blocks: 0x18800 00010000:00010000:1.0:1789762881.103359:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.103381:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=183s v=(0 0) 00010000:00010000:1.0:1789762881.103387:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.103395:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.103413:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.108811:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967477 is committed 00002000:00010000:1.0:1789762881.108925:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:1.0:1789762881.108931:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 100352 -> 102400 00010000:00010000:1.0:1789762881.108942:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.108950:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.108957:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.108963:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762881.108967:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.108986:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.109001:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.109006:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.109092:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567296:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5872us (197890us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789762881.109100:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:1.0:1789762881.109106:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183540340213 time 183540435226 state 0x2 ref 0 00000100:00100000:0.0:1789762881.111211:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762881.111257:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567424 00000100:00100000:1.0:1789762881.111267:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567424 00000100:00100000:1.0:1789762881.111304:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183540340213 time 183540435226 state 0x0 ref 1 00000100:00100000:1.0:1789762881.111314:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183740435226 time 183540435226 state 0x1 ref 1 00000100:00100000:2.0:1789762881.303681:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183740435226 time 183740910978 state 0x0 ref 1 00000100:00100000:2.0:1789762881.303722:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246567424:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762881.303833:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 52428800, mtime: 0x6aad9d41, atime: 0x6aad9d37, ctime: 0x6aad9d41, blocks: 0x19000 00010000:00010000:2.0:1789762881.303846:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.303869:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=183s v=(0 0) 00010000:00010000:2.0:1789762881.303874:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762881.303883:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.303900:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.309829:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967478 is committed 00002000:00010000:3.0:1789762881.309908:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:3.0:1789762881.309913:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 102400 -> 104448 00010000:00010000:3.0:1789762881.309926:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.309936:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.309950:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.309955:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762881.309959:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.309965:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.309979:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.309995:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5a3e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762881.310075:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246567424:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6372us (198865us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789762881.310083:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:3.0:1789762881.310089:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183740435226 time 183740910978 state 0x2 ref 0 00000100:00100000:0.0:1789762881.312206:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762881.312262:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567552 00000100:00100000:1.0:1789762881.312277:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567552 00000100:00100000:1.0:1789762881.312333:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183740435226 time 183740910978 state 0x0 ref 1 00000100:00100000:1.0:1789762881.312349:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183940910978 time 183740910978 state 0x1 ref 1 00000004:00080000:0.0:1789762881.338892:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 183776137988ns, next at 184776133269ns, rc = 0 00000100:00100000:1.0:1789762881.338925:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254914432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762881.339004:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762881.339072:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914432 00000100:00100000:3.0:1789762881.339082:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914432 00000100:00080000:0.0:1789762881.339133:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762881.339157:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789762881.339169:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254914432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762881.339188:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3871240192 avail 3630059520 00000100:00100000:3.0:1789762881.339242:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254914432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762881.339253:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789762881.339305:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254914432:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1789762881.339717:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789762881.339736:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1789762881.339865:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789762881.339879:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f799fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254914560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762881.339921:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762881.339984:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914560 00000100:00100000:1.0:1789762881.339992:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914560 00000100:00100000:1.0:1789762881.340059:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789762881.340076:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254914560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762881.340103:0:12136:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6 count 1 00002000:00010000:1.0:1789762881.340133:0:12136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad9d36, atime: 0x6aad9d36, ctime: 0x6aad9d36, blocks: 0x4000 00010000:00010000:1.0:1789762881.340140:0:12136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.340156:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=183s v=(0 0) 00010000:00010000:1.0:1789762881.340161:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.340168:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.340181:0:12136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.340189:0:12136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.340196:0:12136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.340216:0:12136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762881.340243:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762881.340253:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.340266:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762881.340272:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.340289:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.340304:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.340311:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a3eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762881.340354:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762881.340357:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762881.340363:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762881.340403:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254914560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 335us (481us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789762881.340413:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000004:00080000:3.0:1789762881.340444:0:3417:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b33f799fb80/2, rc 0, transno 4294967479 00000100:00100000:3.0:1789762881.340452:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f799fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254914560:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789762881.340772:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00010000:00010000:3.0:1789762881.403233:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762881.503825:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183940910978 time 183941061378 state 0x0 ref 1 00000100:00100000:0.0:1789762881.503852:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567552:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762881.503899:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 53477376, mtime: 0x6aad9d41, atime: 0x6aad9d37, ctime: 0x6aad9d41, blocks: 0x19800 00010000:00010000:0.0:1789762881.503907:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.503920:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=183s v=(0 0) 00010000:00010000:0.0:1789762881.503924:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762881.503939:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.503952:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762881.509197:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967480 is committed 00000001:00080000:3.0:1789762881.509206:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967479 is committed 00002000:00010000:0.0:1789762881.509270:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:0.0:1789762881.509276:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 104448 -> 106496 00010000:00010000:0.0:1789762881.509285:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.509293:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.509299:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.509304:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762881.509308:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.509315:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.509327:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.509342:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762881.509403:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567552:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5563us (197197us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789762881.509410:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:0.0:1789762881.509416:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183940910978 time 183941061378 state 0x2 ref 0 00000100:00100000:2.0:1789762881.511424:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762881.511476:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567680 00000100:00100000:1.0:1789762881.511487:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567680 00000100:00100000:1.0:1789762881.511544:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 183940910978 time 183941061378 state 0x0 ref 1 00000100:00100000:1.0:1789762881.511560:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184141061378 time 183941061378 state 0x1 ref 1 00000100:00100000:0.0:1789762881.703959:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184141061378 time 184141197406 state 0x0 ref 1 00000100:00100000:0.0:1789762881.703993:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567680:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762881.704055:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 54525952, mtime: 0x6aad9d41, atime: 0x6aad9d37, ctime: 0x6aad9d41, blocks: 0x1a000 00010000:00010000:0.0:1789762881.704063:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.704077:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=184s v=(0 0) 00010000:00010000:0.0:1789762881.704081:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762881.704086:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762881.704105:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762881.711243:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967481 is committed 00002000:00010000:1.0:1789762881.711339:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:1.0:1789762881.711345:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 106496 -> 108544 00010000:00010000:1.0:1789762881.711358:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.711370:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.711378:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.711383:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762881.711388:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.711396:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.711414:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.711431:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a3f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762881.711525:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567680:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7540us (200101us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789762881.711539:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:1.0:1789762881.711549:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184141061378 time 184141197406 state 0x2 ref 0 00000100:00100000:3.0:1789762881.713654:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762881.713718:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567808 00000100:00100000:2.0:1789762881.713731:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567808 00000100:00100000:2.0:1789762881.713801:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184141061378 time 184141197406 state 0x0 ref 1 00000100:00100000:2.0:1789762881.713813:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184341197406 time 184141197406 state 0x1 ref 1 00000100:00100000:1.0:1789762881.904211:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184341197406 time 184341434786 state 0x0 ref 1 00000100:00100000:1.0:1789762881.904265:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246567808:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762881.904389:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 55574528, mtime: 0x6aad9d41, atime: 0x6aad9d37, ctime: 0x6aad9d41, blocks: 0x1a800 00010000:00010000:1.0:1789762881.904403:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.904426:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=184s v=(0 0) 00010000:00010000:1.0:1789762881.904432:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762881.904441:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762881.904459:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762881.911476:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967482 is committed 00002000:00010000:2.0:1789762881.911586:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:2.0:1789762881.911591:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762881 -> 1789762882 00002000:00010000:2.0:1789762881.911593:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762881 -> 1789762882 00002000:00010000:2.0:1789762881.911595:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 108544 -> 110592 00010000:00010000:2.0:1789762881.911607:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.911617:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.911630:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.911635:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762881.911639:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.911645:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.911660:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762881.911666:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d34b62/0x5915dfb1c1b5a400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762881.911742:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246567808:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7501us (198090us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789762881.911771:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:2.0:1789762881.911778:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184341197406 time 184341434786 state 0x2 ref 0 00000100:00100000:3.0:1789762881.914113:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762881.914170:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246567936 00000100:00100000:0.0:1789762881.914187:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246567936 00000100:00100000:0.0:1789762881.914229:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184341197406 time 184341434786 state 0x0 ref 1 00000100:00100000:0.0:1789762881.914241:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184541434786 time 184341434786 state 0x1 ref 1 00000100:00100000:3.0:1789762882.104304:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184541434786 time 184541539801 state 0x0 ref 1 00000100:00100000:3.0:1789762882.104337:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567936:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762882.104398:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 56623104, mtime: 0x6aad9d42, atime: 0x6aad9d37, ctime: 0x6aad9d42, blocks: 0x1b000 00010000:00010000:3.0:1789762882.104408:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.104439:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=184s v=(0 0) 00010000:00010000:3.0:1789762882.104444:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762882.104449:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762882.104461:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762882.109991:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967483 is committed 00002000:00010000:0.0:1789762882.110083:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:0.0:1789762882.110088:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 110592 -> 112640 00010000:00010000:0.0:1789762882.110097:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.110106:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.110113:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.110118:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762882.110121:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.110129:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.110142:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.110147:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050becb04/0x5915dfb1c1b5a407 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762882.110211:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246567936:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5888us (196100us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789762882.110220:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:0.0:1789762882.110226:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184541434786 time 184541539801 state 0x2 ref 0 00000100:00100000:3.0:1789762882.112381:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762882.112429:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568064 00000100:00100000:1.0:1789762882.112439:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568064 00000100:00100000:1.0:1789762882.112485:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184541434786 time 184541539801 state 0x0 ref 1 00000100:00100000:1.0:1789762882.112497:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184741539801 time 184541539801 state 0x1 ref 1 00000100:00100000:1.0:1789762882.304386:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184741539801 time 184741623413 state 0x0 ref 1 00000100:00100000:1.0:1789762882.304415:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568064:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762882.304462:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 57671680, mtime: 0x6aad9d42, atime: 0x6aad9d37, ctime: 0x6aad9d42, blocks: 0x1b800 00010000:00010000:1.0:1789762882.304469:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.304483:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=184s v=(0 0) 00010000:00010000:1.0:1789762882.304486:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.304491:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.304502:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762882.310120:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967484 is committed 00002000:00010000:1.0:1789762882.310184:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:1.0:1789762882.310189:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 112640 -> 114688 00010000:00010000:1.0:1789762882.310198:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.310207:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.310213:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.310224:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762882.310228:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.310234:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.310247:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.310253:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a40e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.310305:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568064:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5903us (197924us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789762882.310314:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:1.0:1789762882.310320:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184741539801 time 184741623413 state 0x2 ref 0 00000100:00100000:0.0:1789762882.312593:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762882.312645:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568192 00000100:00100000:2.0:1789762882.312653:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568192 00000100:00100000:2.0:1789762882.312685:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184741539801 time 184741623413 state 0x0 ref 1 00000100:00100000:2.0:1789762882.312700:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184941623413 time 184741623413 state 0x1 ref 1 00010000:00010000:2.0:1789762882.426889:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762882.504493:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184941623413 time 184941730871 state 0x0 ref 1 00000100:00100000:1.0:1789762882.504519:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246568192:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762882.504570:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 58720256, mtime: 0x6aad9d42, atime: 0x6aad9d37, ctime: 0x6aad9d42, blocks: 0x1c000 00010000:00010000:1.0:1789762882.504578:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.504607:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=184s v=(0 0) 00010000:00010000:1.0:1789762882.504611:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762882.504616:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.504626:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762882.509907:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967485 is committed 00002000:00010000:1.0:1789762882.509982:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:1.0:1789762882.509987:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 114688 -> 116736 00010000:00010000:1.0:1789762882.509996:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.510005:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.510012:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.510017:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762882.510021:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.510041:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.510065:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762882.510071:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5a415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762882.510136:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246568192:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5627us (197543us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789762882.510149:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:1.0:1789762882.510156:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184941623413 time 184941730871 state 0x2 ref 0 00000100:00100000:3.0:1789762882.512328:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762882.512373:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568320 00000100:00100000:0.0:1789762882.512381:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568320 00000100:00100000:0.0:1789762882.512414:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 184941623413 time 184941730871 state 0x0 ref 1 00000100:00100000:0.0:1789762882.512423:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185141730871 time 184941730871 state 0x1 ref 1 00000100:00100000:2.0:1789762882.704577:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185141730871 time 185141815423 state 0x0 ref 1 00000100:00100000:2.0:1789762882.704607:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246568320:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762882.704664:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 59768832, mtime: 0x6aad9d42, atime: 0x6aad9d37, ctime: 0x6aad9d42, blocks: 0x1c800 00010000:00010000:2.0:1789762882.704673:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.704695:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=185s v=(0 0) 00010000:00010000:2.0:1789762882.704699:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762882.704703:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.704716:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762882.709862:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967486 is committed 00002000:00010000:2.0:1789762882.709954:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:2.0:1789762882.709959:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 116736 -> 118784 00010000:00010000:2.0:1789762882.709970:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.709982:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.710007:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.710013:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762882.710016:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.710036:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.710051:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762882.710055:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a41c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762882.710115:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246568320:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5521us (197787us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789762882.710124:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:2.0:1789762882.710130:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185141730871 time 185141815423 state 0x2 ref 0 00000100:00100000:3.0:1789762882.712662:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762882.712720:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568448 00000100:00100000:1.0:1789762882.712729:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568448 00000100:00100000:1.0:1789762882.712794:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185141730871 time 185141815423 state 0x0 ref 1 00000100:00100000:1.0:1789762882.712806:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185341815423 time 185141815423 state 0x1 ref 1 00000100:00100000:0.0:1789762882.904668:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185341815423 time 185341907493 state 0x0 ref 1 00000100:00100000:0.0:1789762882.904698:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568448:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762882.904746:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 60817408, mtime: 0x6aad9d42, atime: 0x6aad9d37, ctime: 0x6aad9d42, blocks: 0x1d000 00010000:00010000:0.0:1789762882.904776:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.904789:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=185s v=(0 0) 00010000:00010000:0.0:1789762882.904793:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762882.904797:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.904808:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762882.909210:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967487 is committed 00002000:00010000:0.0:1789762882.909270:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:0.0:1789762882.909275:0:12138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762882 -> 1789762883 00002000:00010000:0.0:1789762882.909277:0:12138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762882 -> 1789762883 00002000:00010000:0.0:1789762882.909279:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 118784 -> 120832 00010000:00010000:0.0:1789762882.909288:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.909296:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.909303:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.909308:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762882.909311:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.909318:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.909330:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762882.909335:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762882.909401:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568448:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4717us (196739us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789762882.909408:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:0.0:1789762882.909414:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185341815423 time 185341907493 state 0x2 ref 0 00000100:00100000:2.0:1789762882.911624:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762882.911680:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568576 00000100:00100000:1.0:1789762882.911689:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568576 00000100:00100000:1.0:1789762882.911726:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185341815423 time 185341907493 state 0x0 ref 1 00000100:00100000:1.0:1789762882.911737:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185541907493 time 185341907493 state 0x1 ref 1 00000100:00100000:1.0:1789762883.104740:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185541907493 time 185541976190 state 0x0 ref 1 00000100:00100000:1.0:1789762883.104800:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246568576:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:0.0:1789762883.104828:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789762883.104854:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 61865984, mtime: 0x6aad9d43, atime: 0x6aad9d37, ctime: 0x6aad9d43, blocks: 0x1d800 00010000:00010000:1.0:1789762883.104876:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.104891:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=185s v=(0 0) 00010000:00010000:1.0:1789762883.104895:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.104902:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.104916:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762883.109318:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967488 is committed 00002000:00010000:1.0:1789762883.109392:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:1.0:1789762883.109397:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 120832 -> 122880 00010000:00010000:1.0:1789762883.109407:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.109418:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.109427:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.109435:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762883.109439:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.109447:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.109471:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.109480:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5a42a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762883.109543:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246568576:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4767us (197916us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1789762883.109552:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:1.0:1789762883.109560:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185541907493 time 185541976190 state 0x2 ref 0 00000100:00100000:3.0:1789762883.111634:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762883.111676:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568704 00000100:00100000:2.0:1789762883.111684:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568704 00000100:00100000:2.0:1789762883.111721:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185541907493 time 185541976190 state 0x0 ref 1 00000100:00100000:2.0:1789762883.111730:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185741976190 time 185541976190 state 0x1 ref 1 00000100:00100000:2.0:1789762883.304843:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185741976190 time 185742075876 state 0x0 ref 1 00000100:00100000:2.0:1789762883.304887:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568704:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762883.304960:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 62914560, mtime: 0x6aad9d43, atime: 0x6aad9d37, ctime: 0x6aad9d43, blocks: 0x1e000 00010000:00010000:2.0:1789762883.304973:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.304995:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=185s v=(0 0) 00010000:00010000:2.0:1789762883.305001:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762883.305009:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.305058:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762883.314323:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967489 is committed 00002000:00010000:2.0:1789762883.314463:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:2.0:1789762883.314472:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 122880 -> 124928 00010000:00010000:2.0:1789762883.314488:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.314506:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.314518:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.314540:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762883.314547:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.314558:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.314597:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.314608:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5a431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.314718:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568704:12345-192.168.203.36@tcp:4:dd.500 Request processed in 9844us (203075us total) trans 4294967489 rc 0/0 00000100:00100000:2.0:1789762883.314814:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:2.0:1789762883.314825:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185741976190 time 185742075876 state 0x2 ref 0 00000100:00100000:3.0:1789762883.318714:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762883.318844:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568832 00000100:00100000:0.0:1789762883.318860:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568832 00000100:00100000:0.0:1789762883.318920:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185741976190 time 185742075876 state 0x0 ref 1 00000100:00100000:0.0:1789762883.318937:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185942075876 time 185742075876 state 0x1 ref 1 00010000:00010000:2.0:1789762883.452873:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762883.505122:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185942075876 time 185942325816 state 0x0 ref 1 00000100:00100000:0.0:1789762883.505188:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246568832:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762883.505276:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 63963136, mtime: 0x6aad9d43, atime: 0x6aad9d37, ctime: 0x6aad9d43, blocks: 0x1e800 00010000:00010000:0.0:1789762883.505290:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.505311:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=185s v=(0 0) 00010000:00010000:0.0:1789762883.505318:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762883.505326:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.505357:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762883.515905:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967490 is committed 00002000:00010000:0.0:1789762883.516075:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:0.0:1789762883.516086:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 124928 -> 126976 00010000:00010000:0.0:1789762883.516103:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.516122:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.516134:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.516144:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762883.516153:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.516172:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.516206:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762883.516225:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a438 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762883.516350:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246568832:12345-192.168.203.36@tcp:4:dd.500 Request processed in 11174us (197632us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1789762883.516388:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:0.0:1789762883.516401:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185942075876 time 185942325816 state 0x2 ref 0 00000100:00100000:2.0:1789762883.520004:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762883.520084:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246568960 00000100:00100000:1.0:1789762883.520097:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246568960 00000100:00100000:1.0:1789762883.520159:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 185942075876 time 185942325816 state 0x0 ref 1 00000100:00100000:1.0:1789762883.520173:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186142325816 time 185942325816 state 0x1 ref 1 00000100:00100000:1.0:1789762883.705231:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186142325816 time 186142462292 state 0x0 ref 1 00000100:00100000:1.0:1789762883.705276:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568960:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762883.705372:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 65011712, mtime: 0x6aad9d43, atime: 0x6aad9d37, ctime: 0x6aad9d43, blocks: 0x1f000 00010000:00010000:1.0:1789762883.705384:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.705411:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=186s v=(0 0) 00010000:00010000:1.0:1789762883.705416:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.705444:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.705463:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762883.713476:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967491 is committed 00002000:00010000:2.0:1789762883.713713:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:2.0:1789762883.713722:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 126976 -> 129024 00010000:00010000:2.0:1789762883.713742:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.713837:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.713851:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.713860:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762883.713866:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.713878:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.713903:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762883.713913:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a43f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762883.714053:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246568960:12345-192.168.203.36@tcp:4:dd.500 Request processed in 8793us (194045us total) trans 4294967491 rc 0/0 00000100:00100000:2.0:1789762883.714067:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:2.0:1789762883.714079:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186142325816 time 186142462292 state 0x2 ref 0 00000100:00100000:1.0:1789762883.718171:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762883.718257:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569088 00000100:00100000:2.0:1789762883.718289:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569088 00000100:00100000:2.0:1789762883.718365:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186142325816 time 186142462292 state 0x0 ref 1 00000100:00100000:2.0:1789762883.718388:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186342462292 time 186142462292 state 0x1 ref 1 00000100:00100000:1.0:1789762883.905418:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186342462292 time 186342647720 state 0x0 ref 1 00000100:00100000:1.0:1789762883.905490:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569088:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762883.905587:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 66060288, mtime: 0x6aad9d43, atime: 0x6aad9d37, ctime: 0x6aad9d43, blocks: 0x1f800 00010000:00010000:1.0:1789762883.905600:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.905628:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=186s v=(0 0) 00010000:00010000:1.0:1789762883.905633:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762883.905643:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.905661:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762883.912353:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967492 is committed 00002000:00010000:1.0:1789762883.912421:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:1.0:1789762883.912427:0:6916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762883 -> 1789762884 00002000:00010000:1.0:1789762883.912429:0:6916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762883 -> 1789762884 00002000:00010000:1.0:1789762883.912432:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 129024 -> 131072 00010000:00010000:1.0:1789762883.912443:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.912471:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.912478:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.912484:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762883.912488:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.912498:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.912517:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762883.912522:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762883.912591:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569088:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7148us (194422us total) trans 4294967492 rc 0/0 00000100:00100000:1.0:1789762883.912600:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:1.0:1789762883.912608:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186342462292 time 186342647720 state 0x2 ref 0 00000100:00100000:0.0:1789762883.915150:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762883.915191:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569216 00000100:00100000:3.0:1789762883.915201:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569216 00000100:00100000:3.0:1789762883.915242:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186342462292 time 186342647720 state 0x0 ref 1 00000100:00100000:3.0:1789762883.915254:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186542647720 time 186342647720 state 0x1 ref 1 00000100:00100000:2.0:1789762884.105562:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186542647720 time 186542799667 state 0x0 ref 1 00000100:00100000:2.0:1789762884.105592:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569216:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762884.105648:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 67108864, mtime: 0x6aad9d44, atime: 0x6aad9d37, ctime: 0x6aad9d44, blocks: 0x20000 00010000:00010000:2.0:1789762884.105657:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.105671:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=186s v=(0 0) 00010000:00010000:2.0:1789762884.105674:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762884.105679:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.105691:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762884.111199:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967493 is committed 00002000:00010000:2.0:1789762884.111292:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:2.0:1789762884.111297:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 131072 -> 133120 00010000:00010000:2.0:1789762884.111306:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.111314:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.111332:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.111337:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762884.111341:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.111358:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.111372:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.111378:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a44d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762884.111429:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569216:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5851us (196280us total) trans 4294967493 rc 0/0 00000100:00100000:2.0:1789762884.111436:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:2.0:1789762884.111441:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186542647720 time 186542799667 state 0x2 ref 0 00000100:00100000:0.0:1789762884.114383:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762884.114468:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569344 00000100:00100000:2.0:1789762884.114485:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569344 00000100:00100000:2.0:1789762884.114551:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186542647720 time 186542799667 state 0x0 ref 1 00000100:00100000:2.0:1789762884.114568:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186742799667 time 186542799667 state 0x1 ref 1 00000100:00100000:0.0:1789762884.305701:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186742799667 time 186742934282 state 0x0 ref 1 00000100:00100000:0.0:1789762884.305741:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246569344:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762884.305866:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 68157440, mtime: 0x6aad9d44, atime: 0x6aad9d37, ctime: 0x6aad9d44, blocks: 0x20800 00010000:00010000:0.0:1789762884.305876:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.305893:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=186s v=(0 0) 00010000:00010000:0.0:1789762884.305898:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762884.305903:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762884.305918:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762884.311658:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967494 is committed 00002000:00010000:2.0:1789762884.311737:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:2.0:1789762884.311746:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 133120 -> 135168 00010000:00010000:2.0:1789762884.311778:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.311790:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.311800:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.311808:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762884.311813:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.311822:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.311842:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.311850:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5a454 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762884.311929:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246569344:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6209us (197549us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789762884.311948:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:2.0:1789762884.311954:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186742799667 time 186742934282 state 0x2 ref 0 00000100:00100000:0.0:1789762884.314377:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762884.314431:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569472 00000100:00100000:1.0:1789762884.314448:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569472 00000100:00100000:1.0:1789762884.314489:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186742799667 time 186742934282 state 0x0 ref 1 00000100:00100000:1.0:1789762884.314499:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186942934282 time 186742934282 state 0x1 ref 1 00000100:00100000:2.0:1789762884.410967:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254914688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762884.410971:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254914816:0@lo:400:kworker.0 00000100:00100000:1.0:1789762884.411042:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254914944:0@lo:400:kworker.0 00000100:00100000:3.0:1789762884.411093:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762884.411107:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762884.411187:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254915456:0@lo:400:kworker.0 00000100:00100000:3.0:1789762884.411194:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254915328:0@lo:400:kworker.0 00000100:00100000:0.0:1789762884.411195:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254915072:0@lo:400:kworker.0 00000100:00100000:1.0:1789762884.411225:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762884.411245:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762884.411280:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789762884.411287:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254915200:0@lo:400:kworker.0 00000100:00100000:1.0:1789762884.411294:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914944 00000100:00100000:0.0:1789762884.411303:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762884.411308:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914944 00000100:00100000:3.0:1789762884.411340:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762884.411373:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915328 00000100:00100000:1.0:1789762884.411378:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915328 00000100:00100000:0.0:1789762884.411399:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915072 00000100:00100000:0.0:1789762884.411408:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915072 00000100:00100000:3.0:1789762884.411416:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914816 00000100:00100000:3.0:1789762884.411423:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914816 00000100:00100000:1.0:1789762884.411431:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789762884.411449:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254914944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762884.411472:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789762884.411486:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254915328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762884.411494:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789762884.411506:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254914816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762884.411517:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254914944:12345-0@lo:400:kworker.0 Request processed in 76us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762884.411527:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789762884.411564:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789762884.411588:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254915072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762884.411592:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254914816:12345-0@lo:400:kworker.0 Request processed in 81us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762884.411593:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254915328:12345-0@lo:400:kworker.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762884.411631:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254915072:12345-0@lo:400:kworker.0 Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762884.411642:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789762884.411646:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789762884.411649:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789762884.411688:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915456 00000100:00100000:0.0:1789762884.411694:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915456 00000100:00080000:1.0:1789762884.411697:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762884.411707:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762884.411784:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915200 00000100:00100000:0.0:1789762884.411788:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915200 00000100:00100000:1.0:1789762884.411796:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254915072:0@lo:400:kworker.0 00000100:00100000:3.0:1789762884.411807:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254915328:0@lo:400:kworker.0 00000100:00080000:1.0:1789762884.411839:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762884.411845:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254914816:0@lo:400:kworker.0 00000100:00100000:0.0:1789762884.411850:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789762884.411876:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254915456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762884.411880:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254914944:0@lo:400:kworker.0 00000100:00100000:3.0:1789762884.411909:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789762884.411929:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fc7b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254915200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762884.411940:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254915456:12345-0@lo:400:kworker.0 Request processed in 68us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762884.411951:0:3417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000100:00100000:0.0:1789762884.411952:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:1.0:1789762884.411961:0:3417:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c172a680, transno 4294967325 00000004:00080000:1.0:1789762884.411982:0:3417:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c172bb80, transno 4294967326 00000100:00100000:3.0:1789762884.411989:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fc7b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254915200:12345-0@lo:400:kworker.0 Request processed in 67us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762884.411990:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254915456:0@lo:400:kworker.0 00000100:00100000:3.0:1789762884.412005:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789762884.412235:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762884.412289:0:3420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967479 gen 2 00000100:00100000:1.0:1789762884.412295:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254914688 00000004:00080000:3.0:1789762884.412297:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b33f799fb80, transno 4294967479 00000100:00100000:1.0:1789762884.412301:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254914688 00000100:00100000:3.0:1789762884.412319:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254915200:0@lo:400:kworker.0 00000100:00100000:1.0:1789762884.412341:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789762884.412352:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254914688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789762884.412381:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42320448 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762884.412425:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254914688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762884.412430:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789762884.412466:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254914688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789762884.476266:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762884.505782:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186942934282 time 186943020515 state 0x0 ref 1 00000100:00100000:1.0:1789762884.505820:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569472:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762884.505888:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 69206016, mtime: 0x6aad9d44, atime: 0x6aad9d37, ctime: 0x6aad9d44, blocks: 0x21000 00010000:00010000:1.0:1789762884.505898:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.505916:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=186s v=(0 0) 00010000:00010000:1.0:1789762884.505920:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762884.505926:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.505939:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762884.511100:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967495 is committed 00002000:00010000:2.0:1789762884.511173:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:2.0:1789762884.511179:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 135168 -> 137216 00010000:00010000:2.0:1789762884.511188:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.511197:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.511204:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.511210:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762884.511214:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.511221:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.511237:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762884.511254:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7e0703/0x5915dfb1c1b5a45b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762884.511320:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569472:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5521us (196947us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789762884.511328:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:2.0:1789762884.511334:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186942934282 time 186943020515 state 0x2 ref 0 00000100:00100000:3.0:1789762884.513436:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762884.513481:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569600 00000100:00100000:2.0:1789762884.513491:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569600 00000100:00100000:2.0:1789762884.513529:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 186942934282 time 186943020515 state 0x0 ref 1 00000100:00100000:2.0:1789762884.513539:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187143020515 time 186943020515 state 0x1 ref 1 00000100:00100000:1.0:1789762884.705910:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187143020515 time 187143144487 state 0x0 ref 1 00000100:00100000:1.0:1789762884.705957:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246569600:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762884.706056:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 70254592, mtime: 0x6aad9d44, atime: 0x6aad9d37, ctime: 0x6aad9d44, blocks: 0x21800 00010000:00010000:1.0:1789762884.706067:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.706083:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=187s v=(0 0) 00010000:00010000:1.0:1789762884.706088:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762884.706094:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.706110:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762884.711217:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967496 is committed 00002000:00010000:1.0:1789762884.711299:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:1.0:1789762884.711304:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 137216 -> 139264 00010000:00010000:1.0:1789762884.711315:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.711323:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.711330:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.711352:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762884.711357:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.711365:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.711381:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.711387:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a462 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762884.711461:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246569600:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5528us (198027us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789762884.711472:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:1.0:1789762884.711481:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187143020515 time 187143144487 state 0x2 ref 0 00000100:00100000:3.0:1789762884.713518:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762884.713566:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569728 00000100:00100000:2.0:1789762884.713576:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569728 00000100:00100000:2.0:1789762884.713616:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187143020515 time 187143144487 state 0x0 ref 1 00000100:00100000:2.0:1789762884.713626:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187343144487 time 187143144487 state 0x1 ref 1 00000100:00100000:3.0:1789762884.906065:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187343144487 time 187343303255 state 0x0 ref 1 00000100:00100000:3.0:1789762884.906095:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f799fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569728:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762884.906144:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 71303168, mtime: 0x6aad9d44, atime: 0x6aad9d37, ctime: 0x6aad9d44, blocks: 0x22000 00010000:00010000:3.0:1789762884.906164:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.906177:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=187s v=(0 0) 00010000:00010000:3.0:1789762884.906181:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762884.906186:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762884.906198:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762884.911319:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967497 is committed 00002000:00010000:1.0:1789762884.911395:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:1.0:1789762884.911402:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762884 -> 1789762885 00002000:00010000:1.0:1789762884.911404:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762884 -> 1789762885 00002000:00010000:1.0:1789762884.911407:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 139264 -> 141312 00010000:00010000:1.0:1789762884.911418:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.911445:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.911452:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.911458:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762884.911462:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.911470:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.911488:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762884.911493:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbd04d53/0x5915dfb1c1b5a469 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762884.911578:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f799fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246569728:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5495us (198061us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789762884.911589:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:1.0:1789762884.911598:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187343144487 time 187343303255 state 0x2 ref 0 00000100:00100000:0.0:1789762884.913703:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762884.913769:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569856 00000100:00100000:2.0:1789762884.913780:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569856 00000100:00100000:2.0:1789762884.913822:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187343144487 time 187343303255 state 0x0 ref 1 00000100:00100000:2.0:1789762884.913834:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187543303255 time 187343303255 state 0x1 ref 1 00000100:00100000:3.0:1789762884.995692:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762884.995724:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762884.995785:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246569984 00000100:00100000:2.0:1789762884.995798:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246569984 00000100:00100000:0.0:1789762884.995799:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246570112 00000100:00100000:3.0:1789762884.995799:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762884.995814:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246570112 00000100:00100000:3.0:1789762884.995863:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762884.995864:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246570240 00000100:00100000:2.0:1789762884.995874:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 247 00000100:00100000:1.0:1789762884.995886:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246570240 00000100:00100000:0.0:1789762884.995898:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246570368 00000100:00100000:2.0:1789762884.995901:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246569984:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762884.995906:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246570368 00000100:00100000:1.0:1789762884.995947:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:1.0:1789762884.995970:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246570240:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762884.995971:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:2.0:1789762884.995986:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246569984:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 85us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762884.995995:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:0.0:1789762884.995997:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f764bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246570112:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762884.996023:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 247 00000100:00100000:3.0:1789762884.996030:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246570368:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762884.996037:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246570240:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762884.996050:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:0.0:1789762884.996092:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f764bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246570112:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762884.996092:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246570368:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762884.996105:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00080000:1.0:1789762884.996117:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762884.996126:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00080000:1.0:1789762884.996129:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762885.106183:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187543303255 time 187543416353 state 0x0 ref 1 00000100:00100000:1.0:1789762885.106241:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246569856:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:2.0:1789762885.106263:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789762885.106309:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 72351744, mtime: 0x6aad9d45, atime: 0x6aad9d37, ctime: 0x6aad9d45, blocks: 0x22800 00010000:00010000:1.0:1789762885.106319:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.106337:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=187s v=(0 0) 00010000:00010000:1.0:1789762885.106342:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762885.106347:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.106361:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762885.111411:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967498 is committed 00002000:00010000:1.0:1789762885.111487:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:1.0:1789762885.111493:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 141312 -> 143360 00010000:00010000:1.0:1789762885.111503:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.111524:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.111532:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.111537:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762885.111541:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.111548:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.111572:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.111580:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a470 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762885.111651:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246569856:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5449us (197949us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789762885.111660:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:1.0:1789762885.111668:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187543303255 time 187543416353 state 0x2 ref 0 00000100:00100000:2.0:1789762885.113813:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762885.113845:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246570496 00000100:00100000:1.0:1789762885.113860:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246570496 00000100:00100000:1.0:1789762885.113896:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187543303255 time 187543416353 state 0x0 ref 1 00000100:00100000:1.0:1789762885.113905:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187743416353 time 187543416353 state 0x1 ref 1 00000100:00100000:1.0:1789762885.306327:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187743416353 time 187743560320 state 0x0 ref 1 00000100:00100000:1.0:1789762885.306379:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246570496:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762885.306468:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 73400320, mtime: 0x6aad9d45, atime: 0x6aad9d37, ctime: 0x6aad9d45, blocks: 0x23000 00010000:00010000:1.0:1789762885.306482:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.306504:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=187s v=(0 0) 00010000:00010000:1.0:1789762885.306510:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762885.306519:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.306537:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762885.314183:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967499 is committed 00002000:00010000:1.0:1789762885.314316:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:1.0:1789762885.314326:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 143360 -> 145408 00010000:00010000:1.0:1789762885.314352:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.314360:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.314377:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.314382:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762885.314386:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.314392:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.314405:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.314431:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a477 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762885.314523:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246570496:12345-192.168.203.36@tcp:4:dd.500 Request processed in 8153us (200707us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789762885.314538:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:1.0:1789762885.314546:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187743416353 time 187743560320 state 0x2 ref 0 00000100:00100000:0.0:1789762885.318537:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762885.318635:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246570624 00000100:00100000:1.0:1789762885.318652:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246570624 00000100:00100000:1.0:1789762885.318715:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187743416353 time 187743560320 state 0x0 ref 1 00000100:00100000:1.0:1789762885.318736:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187943560320 time 187743560320 state 0x1 ref 1 00010000:00010000:3.0:1789762885.499038:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762885.506512:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187943560320 time 187943748723 state 0x0 ref 1 00000100:00100000:3.0:1789762885.506553:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246570624:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762885.506620:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 74448896, mtime: 0x6aad9d45, atime: 0x6aad9d37, ctime: 0x6aad9d45, blocks: 0x23800 00010000:00010000:3.0:1789762885.506632:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.506674:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=187s v=(0 0) 00010000:00010000:3.0:1789762885.506680:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762885.506689:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.506707:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762885.513898:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967500 is committed 00002000:00010000:3.0:1789762885.514023:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:3.0:1789762885.514034:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 145408 -> 147456 00010000:00010000:3.0:1789762885.514054:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.514070:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.514082:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.514092:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762885.514098:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.514110:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.514153:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.514164:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a47e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762885.514257:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246570624:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7722us (195721us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789762885.514270:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:3.0:1789762885.514280:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187943560320 time 187943748723 state 0x2 ref 0 00000100:00100000:2.0:1789762885.517958:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762885.518116:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246570752 00000100:00100000:1.0:1789762885.518130:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246570752 00000100:00100000:1.0:1789762885.518183:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 187943560320 time 187943748723 state 0x0 ref 1 00000100:00100000:1.0:1789762885.518203:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188143748723 time 187943748723 state 0x1 ref 1 00000100:00100000:2.0:1789762885.706688:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188143748723 time 188143916900 state 0x0 ref 1 00000100:00100000:2.0:1789762885.706740:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246570752:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762885.706856:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 75497472, mtime: 0x6aad9d45, atime: 0x6aad9d37, ctime: 0x6aad9d45, blocks: 0x24000 00010000:00010000:2.0:1789762885.706869:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.706892:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=188s v=(0 0) 00010000:00010000:2.0:1789762885.706898:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762885.706908:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.706933:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762885.715474:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967501 is committed 00002000:00010000:3.0:1789762885.715624:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:3.0:1789762885.715636:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 147456 -> 149504 00010000:00010000:3.0:1789762885.715662:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.715687:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.715706:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.715723:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762885.715734:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.715830:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.715868:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762885.715886:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5a485 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762885.716053:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246570752:12345-192.168.203.36@tcp:4:dd.500 Request processed in 9331us (198094us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789762885.716072:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:3.0:1789762885.716084:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188143748723 time 188143916900 state 0x2 ref 0 00000100:00100000:2.0:1789762885.719848:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762885.720035:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246570880 00000100:00100000:1.0:1789762885.720054:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246570880 00000100:00100000:1.0:1789762885.720122:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188143748723 time 188143916900 state 0x0 ref 1 00000100:00100000:1.0:1789762885.720139:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188343916900 time 188143916900 state 0x1 ref 1 00000100:00100000:2.0:1789762885.906802:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188343916900 time 188344038842 state 0x0 ref 1 00000100:00100000:2.0:1789762885.906831:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246570880:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762885.906890:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 76546048, mtime: 0x6aad9d45, atime: 0x6aad9d37, ctime: 0x6aad9d45, blocks: 0x24800 00010000:00010000:2.0:1789762885.906898:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.906919:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=188s v=(0 0) 00010000:00010000:2.0:1789762885.906923:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762885.906928:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762885.906939:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762885.911918:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967502 is committed 00002000:00010000:1.0:1789762885.912036:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:1.0:1789762885.912044:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762885 -> 1789762886 00002000:00010000:1.0:1789762885.912046:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762885 -> 1789762886 00002000:00010000:1.0:1789762885.912048:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 149504 -> 151552 00010000:00010000:1.0:1789762885.912060:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.912070:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.912078:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.912083:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762885.912087:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.912111:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.912131:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762885.912136:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a48c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762885.912222:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246570880:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5402us (192378us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789762885.912232:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1789762885.912240:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188343916900 time 188344038842 state 0x2 ref 0 00000100:00100000:0.0:1789762885.914565:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762885.914606:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571008 00000100:00100000:3.0:1789762885.914614:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571008 00000100:00100000:3.0:1789762885.914669:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188343916900 time 188344038842 state 0x0 ref 1 00000100:00100000:3.0:1789762885.914682:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188544038842 time 188344038842 state 0x1 ref 1 00000100:00100000:2.0:1789762886.106867:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188544038842 time 188544105740 state 0x0 ref 1 00000100:00100000:2.0:1789762886.106895:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571008:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762886.106945:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 77594624, mtime: 0x6aad9d46, atime: 0x6aad9d37, ctime: 0x6aad9d46, blocks: 0x25000 00010000:00010000:2.0:1789762886.106952:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.106967:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=188s v=(0 0) 00010000:00010000:2.0:1789762886.106970:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762886.106975:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762886.106986:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762886.111964:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967503 is committed 00002000:00010000:1.0:1789762886.112050:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:1.0:1789762886.112057:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 151552 -> 153600 00010000:00010000:1.0:1789762886.112069:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.112080:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.112087:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.112093:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762886.112109:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.112117:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.112135:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.112140:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a493 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762886.112224:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571008:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5339us (197658us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789762886.112233:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:1.0:1789762886.112241:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188544038842 time 188544105740 state 0x2 ref 0 00000100:00100000:0.0:1789762886.114468:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762886.114514:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571136 00000100:00100000:3.0:1789762886.114523:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571136 00000100:00100000:3.0:1789762886.114559:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188544038842 time 188544105740 state 0x0 ref 1 00000100:00100000:3.0:1789762886.114568:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188744105740 time 188544105740 state 0x1 ref 1 00000100:00100000:3.0:1789762886.307117:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188744105740 time 188744348187 state 0x0 ref 1 00000100:00100000:3.0:1789762886.307163:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571136:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762886.307233:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 78643200, mtime: 0x6aad9d46, atime: 0x6aad9d37, ctime: 0x6aad9d46, blocks: 0x25800 00010000:00010000:3.0:1789762886.307243:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.307261:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=188s v=(0 0) 00010000:00010000:3.0:1789762886.307267:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762886.307275:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.307291:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762886.312059:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967504 is committed 00002000:00010000:3.0:1789762886.312120:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789762886.312125:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 153600 -> 155648 00010000:00010000:3.0:1789762886.312135:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.312144:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.312151:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.312156:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762886.312159:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.312173:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.312188:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.312193:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a49a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762886.312249:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571136:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5099us (197781us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789762886.312259:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:3.0:1789762886.312265:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188744105740 time 188744348187 state 0x2 ref 0 00000100:00100000:2.0:1789762886.314421:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762886.314499:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571264 00000100:00100000:1.0:1789762886.314508:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571264 00000100:00100000:1.0:1789762886.314542:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188744105740 time 188744348187 state 0x0 ref 1 00000100:00100000:1.0:1789762886.314551:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188944348187 time 188744348187 state 0x1 ref 1 00000100:00100000:1.0:1789762886.458912:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254915584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762886.458984:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762886.459045:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915584 00000100:00100000:0.0:1789762886.459053:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915584 00000100:00080000:2.0:1789762886.459091:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762886.459114:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789762886.459126:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254915584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762886.459148:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3848171520 avail 3612356608 00000100:00100000:0.0:1789762886.459196:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254915584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762886.459203:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789762886.459237:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254915584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762886.507200:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188944348187 time 188944436919 state 0x0 ref 1 00000100:00100000:1.0:1789762886.507244:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246571264:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762886.507292:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 79691776, mtime: 0x6aad9d46, atime: 0x6aad9d37, ctime: 0x6aad9d46, blocks: 0x26000 00010000:00010000:1.0:1789762886.507307:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.507321:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=188s v=(0 0) 00010000:00010000:1.0:1789762886.507325:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762886.507329:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.507341:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762886.512791:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967505 is committed 00002000:00010000:1.0:1789762886.512917:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:1.0:1789762886.512922:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 155648 -> 157696 00010000:00010000:1.0:1789762886.512931:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.512940:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.512946:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.512952:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762886.512955:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.512976:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.512990:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.513009:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762886.513074:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246571264:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5838us (198652us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789762886.513082:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:1.0:1789762886.513088:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188944348187 time 188944436919 state 0x2 ref 0 00000100:00100000:0.0:1789762886.516179:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762886.516214:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571392 00000100:00100000:1.0:1789762886.516223:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571392 00000100:00100000:1.0:1789762886.516255:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 188944348187 time 188944436919 state 0x0 ref 1 00000100:00100000:1.0:1789762886.516263:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189144436919 time 188944436919 state 0x1 ref 1 00010000:00010000:3.0:1789762886.522858:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762886.707297:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189144436919 time 189144535565 state 0x0 ref 1 00000100:00100000:1.0:1789762886.707329:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571392:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762886.707390:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 80740352, mtime: 0x6aad9d46, atime: 0x6aad9d37, ctime: 0x6aad9d46, blocks: 0x26800 00010000:00010000:1.0:1789762886.707401:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.707446:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=189s v=(0 0) 00010000:00010000:1.0:1789762886.707450:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762886.707455:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.707467:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762886.712076:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967506 is committed 00002000:00010000:1.0:1789762886.712133:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:1.0:1789762886.712137:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 157696 -> 159744 00010000:00010000:1.0:1789762886.712145:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.712152:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.712158:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.712163:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762886.712166:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.712173:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.712195:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762886.712202:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762886.712251:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571392:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4939us (196072us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789762886.712257:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:1.0:1789762886.712263:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189144436919 time 189144535565 state 0x2 ref 0 00000100:00100000:2.0:1789762886.714483:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762886.714529:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571520 00000100:00100000:3.0:1789762886.714537:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571520 00000100:00100000:3.0:1789762886.714568:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189144436919 time 189144535565 state 0x0 ref 1 00000100:00100000:3.0:1789762886.714577:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189344535565 time 189144535565 state 0x1 ref 1 00000100:00100000:3.0:1789762886.907398:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189344535565 time 189344636524 state 0x0 ref 1 00000100:00100000:3.0:1789762886.907433:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246571520:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762886.907492:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 81788928, mtime: 0x6aad9d46, atime: 0x6aad9d37, ctime: 0x6aad9d46, blocks: 0x27000 00010000:00010000:3.0:1789762886.907500:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.907526:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=189s v=(0 0) 00010000:00010000:3.0:1789762886.907529:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762886.907534:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762886.907545:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762886.912252:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967507 is committed 00002000:00010000:0.0:1789762886.912356:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:0.0:1789762886.912361:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762886 -> 1789762887 00002000:00010000:0.0:1789762886.912363:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762886 -> 1789762887 00002000:00010000:0.0:1789762886.912365:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 159744 -> 161792 00010000:00010000:0.0:1789762886.912374:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.912390:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.912397:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.912402:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762886.912405:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.912412:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.912425:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762886.912430:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007006d81e/0x5915dfb1c1b5a4af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762886.912487:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246571520:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5071us (198006us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789762886.912495:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:0.0:1789762886.912501:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189344535565 time 189344636524 state 0x2 ref 0 00000100:00100000:2.0:1789762886.914662:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762886.914726:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571648 00000100:00100000:1.0:1789762886.914737:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571648 00000100:00100000:1.0:1789762886.914797:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189344535565 time 189344636524 state 0x0 ref 1 00000100:00100000:1.0:1789762886.914806:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189544636524 time 189344636524 state 0x1 ref 1 00000100:00100000:3.0:1789762887.107543:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189544636524 time 189544781139 state 0x0 ref 1 00000100:00100000:3.0:1789762887.107589:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571648:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762887.107642:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 82837504, mtime: 0x6aad9d47, atime: 0x6aad9d37, ctime: 0x6aad9d47, blocks: 0x27800 00000100:00080000:2.0:1789762887.107643:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762887.107652:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.107667:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=189s v=(0 0) 00010000:00010000:3.0:1789762887.107671:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762887.107676:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.107688:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762887.112726:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967508 is committed 00002000:00010000:3.0:1789762887.112801:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789762887.112807:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 161792 -> 163840 00010000:00010000:3.0:1789762887.112830:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.112838:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.112845:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.112850:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762887.112853:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.112861:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.112873:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.112878:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762887.112932:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571648:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5373us (198273us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789762887.112940:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:3.0:1789762887.112946:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189544636524 time 189544781139 state 0x2 ref 0 00000100:00100000:2.0:1789762887.115092:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762887.115145:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571776 00000100:00100000:1.0:1789762887.115156:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571776 00000100:00100000:1.0:1789762887.115205:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189544636524 time 189544781139 state 0x0 ref 1 00000100:00100000:1.0:1789762887.115217:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189744781139 time 189544781139 state 0x1 ref 1 00000100:00100000:1.0:1789762887.307637:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189744781139 time 189744874972 state 0x0 ref 1 00000100:00100000:1.0:1789762887.307674:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246571776:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762887.307732:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 83886080, mtime: 0x6aad9d47, atime: 0x6aad9d37, ctime: 0x6aad9d47, blocks: 0x28000 00010000:00010000:1.0:1789762887.307826:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.307840:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=189s v=(0 0) 00010000:00010000:1.0:1789762887.307844:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762887.307849:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.307861:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762887.313298:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967509 is committed 00002000:00010000:1.0:1789762887.313406:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:1.0:1789762887.313412:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 163840 -> 165888 00010000:00010000:1.0:1789762887.313420:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.313429:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.313435:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.313440:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762887.313444:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.313450:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.313472:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.313477:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762887.313534:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246571776:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5875us (198446us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789762887.313542:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:1.0:1789762887.313548:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189744781139 time 189744874972 state 0x2 ref 0 00000100:00100000:2.0:1789762887.315908:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762887.315984:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246571904 00000100:00100000:0.0:1789762887.316031:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246571904 00000100:00100000:0.0:1789762887.316065:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189744781139 time 189744874972 state 0x0 ref 1 00000100:00100000:0.0:1789762887.316074:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189944874972 time 189744874972 state 0x1 ref 1 00000100:00100000:2.0:1789762887.507810:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189944874972 time 189945044293 state 0x0 ref 1 00000100:00100000:2.0:1789762887.507864:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571904:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762887.507963:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 84934656, mtime: 0x6aad9d47, atime: 0x6aad9d37, ctime: 0x6aad9d47, blocks: 0x28800 00010000:00010000:2.0:1789762887.507975:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.508023:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=189s v=(0 0) 00010000:00010000:2.0:1789762887.508045:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762887.508055:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762887.508090:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762887.514014:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967510 is committed 00002000:00010000:1.0:1789762887.514143:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:1.0:1789762887.514149:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 165888 -> 167936 00010000:00010000:1.0:1789762887.514163:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.514174:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.514181:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.514186:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762887.514190:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.514206:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.514224:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.514229:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5a4c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762887.514305:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246571904:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6457us (198401us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1789762887.514315:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:1.0:1789762887.514321:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189944874972 time 189945044293 state 0x2 ref 0 00000100:00100000:2.0:1789762887.517297:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762887.517344:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572032 00000100:00100000:3.0:1789762887.517358:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572032 00000100:00100000:3.0:1789762887.517416:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 189944874972 time 189945044293 state 0x0 ref 1 00000100:00100000:3.0:1789762887.517429:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190145044293 time 189945044293 state 0x1 ref 1 00010000:00010000:2.0:1789762887.546903:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762887.707894:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190145044293 time 190145132739 state 0x0 ref 1 00000100:00100000:3.0:1789762887.707923:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572032:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762887.707974:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 85983232, mtime: 0x6aad9d47, atime: 0x6aad9d37, ctime: 0x6aad9d47, blocks: 0x29000 00010000:00010000:3.0:1789762887.707982:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.708009:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=190s v=(0 0) 00010000:00010000:3.0:1789762887.708013:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762887.708018:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.708031:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762887.713086:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967511 is committed 00002000:00010000:3.0:1789762887.713159:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789762887.713165:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 167936 -> 169984 00010000:00010000:3.0:1789762887.713176:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.713188:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.713211:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.713220:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762887.713225:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.713236:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.713254:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762887.713263:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762887.713329:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572032:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5417us (196033us total) trans 4294967511 rc 0/0 00000100:00100000:3.0:1789762887.713340:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:3.0:1789762887.713347:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190145044293 time 190145132739 state 0x2 ref 0 00000100:00100000:0.0:1789762887.715670:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762887.715713:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572160 00000100:00100000:1.0:1789762887.715722:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572160 00000100:00100000:1.0:1789762887.715774:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190145044293 time 190145132739 state 0x0 ref 1 00000100:00100000:1.0:1789762887.715783:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190345132739 time 190145132739 state 0x1 ref 1 00000100:00100000:1.0:1789762887.907970:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190345132739 time 190345206222 state 0x0 ref 1 00000100:00100000:1.0:1789762887.908015:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246572160:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762887.908072:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 87031808, mtime: 0x6aad9d47, atime: 0x6aad9d37, ctime: 0x6aad9d47, blocks: 0x29800 00010000:00010000:1.0:1789762887.908081:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.908114:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=190s v=(0 0) 00010000:00010000:1.0:1789762887.908119:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762887.908126:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.908141:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762887.913323:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967512 is committed 00002000:00010000:1.0:1789762887.913395:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:1.0:1789762887.913401:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762887 -> 1789762888 00002000:00010000:1.0:1789762887.913404:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762887 -> 1789762888 00002000:00010000:1.0:1789762887.913407:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 169984 -> 172032 00010000:00010000:1.0:1789762887.913418:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.913431:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.913441:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.913449:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762887.913454:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.913465:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.913494:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762887.913500:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762887.913575:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246572160:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5576us (197893us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789762887.913583:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:1.0:1789762887.913589:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190345132739 time 190345206222 state 0x2 ref 0 00000100:00100000:2.0:1789762887.916026:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762887.916063:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572288 00000100:00100000:1.0:1789762887.916071:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572288 00000100:00100000:1.0:1789762887.916104:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190345132739 time 190345206222 state 0x0 ref 1 00000100:00100000:1.0:1789762887.916113:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190545206222 time 190345206222 state 0x1 ref 1 00000100:00100000:1.0:1789762888.108057:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190545206222 time 190545295699 state 0x0 ref 1 00000100:00100000:1.0:1789762888.108085:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572288:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762888.108135:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 88080384, mtime: 0x6aad9d48, atime: 0x6aad9d37, ctime: 0x6aad9d48, blocks: 0x2a000 00010000:00010000:1.0:1789762888.108142:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.108156:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=190s v=(0 0) 00010000:00010000:1.0:1789762888.108160:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762888.108177:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.108188:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762888.113348:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967513 is committed 00002000:00010000:1.0:1789762888.113405:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:1.0:1789762888.113410:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 172032 -> 174080 00010000:00010000:1.0:1789762888.113418:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.113427:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.113433:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.113438:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762888.113442:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.113449:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.113462:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.113482:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762888.113543:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572288:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5471us (197518us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1789762888.113551:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:1.0:1789762888.113556:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190545206222 time 190545295699 state 0x2 ref 0 00000100:00100000:2.0:1789762888.115892:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762888.115935:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572416 00000100:00100000:3.0:1789762888.115943:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572416 00000100:00100000:3.0:1789762888.115974:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190545206222 time 190545295699 state 0x0 ref 1 00000100:00100000:3.0:1789762888.115998:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190745295699 time 190545295699 state 0x1 ref 1 00000100:00100000:0.0:1789762888.308195:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190745295699 time 190745431650 state 0x0 ref 1 00000100:00100000:0.0:1789762888.308224:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246572416:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762888.308270:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 89128960, mtime: 0x6aad9d48, atime: 0x6aad9d37, ctime: 0x6aad9d48, blocks: 0x2a800 00010000:00010000:0.0:1789762888.308277:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.308291:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=190s v=(0 0) 00010000:00010000:0.0:1789762888.308294:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762888.308299:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.308310:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762888.313477:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967514 is committed 00002000:00010000:3.0:1789762888.313552:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:3.0:1789762888.313557:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 174080 -> 176128 00010000:00010000:3.0:1789762888.313565:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.313574:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.313580:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.313585:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762888.313589:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.313596:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.313609:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.313614:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5a4e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762888.313671:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246572416:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5460us (197779us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789762888.313687:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:3.0:1789762888.313693:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190745295699 time 190745431650 state 0x2 ref 0 00000100:00100000:0.0:1789762888.316272:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762888.316339:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572544 00000100:00100000:1.0:1789762888.316349:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572544 00000100:00100000:1.0:1789762888.316403:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190745295699 time 190745431650 state 0x0 ref 1 00000100:00100000:1.0:1789762888.316415:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190945431650 time 190745431650 state 0x1 ref 1 00000100:00100000:3.0:1789762888.508301:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190945431650 time 190945540304 state 0x0 ref 1 00000100:00100000:3.0:1789762888.508331:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572544:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762888.508382:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 90177536, mtime: 0x6aad9d48, atime: 0x6aad9d37, ctime: 0x6aad9d48, blocks: 0x2b000 00010000:00010000:3.0:1789762888.508389:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.508402:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=190s v=(0 0) 00010000:00010000:3.0:1789762888.508406:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762888.508411:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762888.508421:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762888.512823:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967515 is committed 00002000:00010000:0.0:1789762888.512885:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:0.0:1789762888.512890:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 176128 -> 178176 00010000:00010000:0.0:1789762888.512899:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.512908:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.512921:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.512927:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762888.512930:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.512936:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.512949:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762888.512955:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b95f2738/0x5915dfb1c1b5a4e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762888.513023:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572544:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4706us (196752us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789762888.513030:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:0.0:1789762888.513036:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190945431650 time 190945540304 state 0x2 ref 0 00000100:00100000:2.0:1789762888.515297:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762888.515349:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572672 00000100:00100000:1.0:1789762888.515356:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572672 00000100:00100000:1.0:1789762888.515388:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 190945431650 time 190945540304 state 0x0 ref 1 00000100:00100000:1.0:1789762888.515397:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191145540304 time 190945540304 state 0x1 ref 1 00010000:00010000:3.0:1789762888.570886:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762888.708401:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191145540304 time 191145635554 state 0x0 ref 1 00000100:00100000:1.0:1789762888.708436:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246572672:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762888.708510:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 91226112, mtime: 0x6aad9d48, atime: 0x6aad9d37, ctime: 0x6aad9d48, blocks: 0x2b800 00010000:00010000:1.0:1789762888.708520:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.708565:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=191s v=(0 0) 00010000:00010000:1.0:1789762888.708570:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762888.708577:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.708595:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762888.713694:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967516 is committed 00002000:00010000:1.0:1789762888.713796:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:1.0:1789762888.713801:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 178176 -> 180224 00010000:00010000:1.0:1789762888.713809:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.713818:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.713824:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.713829:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762888.713832:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.713839:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.713872:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.713878:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a4ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762888.713931:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246572672:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5512us (198635us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789762888.713938:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:1.0:1789762888.713944:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191145540304 time 191145635554 state 0x2 ref 0 00000100:00100000:2.0:1789762888.716193:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762888.716237:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572800 00000100:00100000:3.0:1789762888.716244:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572800 00000100:00100000:3.0:1789762888.716278:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191145540304 time 191145635554 state 0x0 ref 1 00000100:00100000:3.0:1789762888.716287:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191345635554 time 191145635554 state 0x1 ref 1 00000100:00100000:2.0:1789762888.908539:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191345635554 time 191345774804 state 0x0 ref 1 00000100:00100000:2.0:1789762888.908574:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246572800:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762888.908633:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 92274688, mtime: 0x6aad9d48, atime: 0x6aad9d37, ctime: 0x6aad9d48, blocks: 0x2c000 00010000:00010000:2.0:1789762888.908644:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.908660:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=191s v=(0 0) 00010000:00010000:2.0:1789762888.908665:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762888.908673:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762888.908688:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762888.913613:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967517 is committed 00002000:00010000:1.0:1789762888.913674:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:1.0:1789762888.913678:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762888 -> 1789762889 00002000:00010000:1.0:1789762888.913681:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762888 -> 1789762889 00002000:00010000:1.0:1789762888.913682:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 180224 -> 182272 00010000:00010000:1.0:1789762888.913691:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.913700:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.913707:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.913712:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762888.913722:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.913729:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.913742:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762888.913748:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a4f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762888.913817:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246572800:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5259us (197624us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789762888.913824:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:1.0:1789762888.913829:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191345635554 time 191345774804 state 0x2 ref 0 00000100:00100000:3.0:1789762888.916155:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762888.916196:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246572928 00000100:00100000:0.0:1789762888.916205:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246572928 00000100:00100000:0.0:1789762888.916239:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191345635554 time 191345774804 state 0x0 ref 1 00000100:00100000:0.0:1789762888.916254:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191545774804 time 191345774804 state 0x1 ref 1 00000100:00100000:3.0:1789762889.108682:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191545774804 time 191545919422 state 0x0 ref 1 00000100:00100000:3.0:1789762889.108739:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572928:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:2.0:1789762889.108769:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762889.108820:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 93323264, mtime: 0x6aad9d49, atime: 0x6aad9d37, ctime: 0x6aad9d49, blocks: 0x2c800 00010000:00010000:3.0:1789762889.108828:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.108842:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=191s v=(0 0) 00010000:00010000:3.0:1789762889.108846:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.108851:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.108863:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762889.113624:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967518 is committed 00002000:00010000:1.0:1789762889.113690:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:1.0:1789762889.113704:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 182272 -> 184320 00010000:00010000:1.0:1789762889.113714:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.113722:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.113729:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.113744:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762889.113748:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.113770:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.113784:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.113790:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a4fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762889.113852:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246572928:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5136us (197697us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789762889.113862:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:1.0:1789762889.113867:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191545774804 time 191545919422 state 0x2 ref 0 00000100:00100000:3.0:1789762889.116240:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762889.116283:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573056 00000100:00100000:1.0:1789762889.116292:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573056 00000100:00100000:1.0:1789762889.116328:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191545774804 time 191545919422 state 0x0 ref 1 00000100:00100000:1.0:1789762889.116337:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191745919422 time 191545919422 state 0x1 ref 1 00000100:00100000:1.0:1789762889.308801:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191745919422 time 191746038280 state 0x0 ref 1 00000100:00100000:1.0:1789762889.308829:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246573056:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762889.308892:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 94371840, mtime: 0x6aad9d49, atime: 0x6aad9d37, ctime: 0x6aad9d49, blocks: 0x2d000 00010000:00010000:1.0:1789762889.308899:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.308913:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=191s v=(0 0) 00010000:00010000:1.0:1789762889.308916:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762889.308921:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.308932:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762889.313676:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967519 is committed 00002000:00010000:1.0:1789762889.313736:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:1.0:1789762889.313741:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 184320 -> 186368 00010000:00010000:1.0:1789762889.313764:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.313774:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.313781:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.313786:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762889.313789:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.313806:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.313820:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.313826:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a503 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762889.313876:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246573056:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5061us (197637us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789762889.313883:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:1.0:1789762889.313888:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191745919422 time 191746038280 state 0x2 ref 0 00000100:00100000:3.0:1789762889.316300:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762889.316335:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573184 00000100:00100000:1.0:1789762889.316343:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573184 00000100:00100000:1.0:1789762889.316374:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191745919422 time 191746038280 state 0x0 ref 1 00000100:00100000:1.0:1789762889.316383:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191946038280 time 191746038280 state 0x1 ref 1 00000100:00100000:1.0:1789762889.508885:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191946038280 time 191946122479 state 0x0 ref 1 00000100:00100000:1.0:1789762889.508916:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246573184:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762889.508965:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 95420416, mtime: 0x6aad9d49, atime: 0x6aad9d37, ctime: 0x6aad9d49, blocks: 0x2d800 00010000:00010000:1.0:1789762889.508989:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.509021:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=191s v=(0 0) 00010000:00010000:1.0:1789762889.509025:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762889.509030:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.509043:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762889.513675:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967520 is committed 00002000:00010000:1.0:1789762889.513735:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:1.0:1789762889.513740:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 186368 -> 188416 00010000:00010000:1.0:1789762889.513761:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.513770:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.513778:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.513783:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762889.513786:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.513792:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.513815:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762889.513821:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a50a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762889.513870:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246573184:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4970us (197572us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789762889.513877:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:1.0:1789762889.513882:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191946038280 time 191946122479 state 0x2 ref 0 00000100:00100000:3.0:1789762889.516093:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762889.516132:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573312 00000100:00100000:1.0:1789762889.516140:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573312 00000100:00100000:1.0:1789762889.516169:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 191946038280 time 191946122479 state 0x0 ref 1 00000100:00100000:1.0:1789762889.516178:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192146122479 time 191946122479 state 0x1 ref 1 00000100:00100000:1.0:1789762889.530908:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254915840:0@lo:400:kworker.0 00000100:00100000:2.0:1789762889.530909:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254915712:0@lo:400:kworker.0 00000100:00100000:0.0:1789762889.530931:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254915968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762889.530944:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254916096:0@lo:400:kworker.0 00000100:00100000:1.0:1789762889.530969:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762889.530988:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762889.531002:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762889.531011:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915840 00000100:00100000:3.0:1789762889.531017:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915840 00000100:00100000:2.0:1789762889.531055:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254916224:0@lo:400:kworker.0 00000100:00100000:0.0:1789762889.531061:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254916480:0@lo:400:kworker.0 00000100:00100000:1.0:1789762889.531063:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254916352:0@lo:400:kworker.0 00000100:00100000:3.0:1789762889.531063:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789762889.531078:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254915840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762889.531086:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762889.531120:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762889.531122:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762889.531132:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915712 00000100:00100000:3.0:1789762889.531138:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254915840:12345-0@lo:400:kworker.0 Request processed in 61us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762889.531139:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915712 00000100:00100000:3.0:1789762889.531151:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789762889.531169:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916352 00000100:00100000:1.0:1789762889.531170:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254915840:0@lo:400:kworker.0 00000100:00100000:0.0:1789762889.531182:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916224 00000100:00100000:3.0:1789762889.531183:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916352 00000100:00100000:2.0:1789762889.531185:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789762889.531188:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916224 00000100:00100000:2.0:1789762889.531197:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254915712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762889.531203:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254915968 00000100:00100000:1.0:1789762889.531208:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254915968 00000100:00100000:0.0:1789762889.531234:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916480 00000100:00100000:3.0:1789762889.531234:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789762889.531239:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916480 00000100:00100000:2.0:1789762889.531245:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254915712:12345-0@lo:400:kworker.0 Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762889.531247:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254916352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762889.531252:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789762889.531260:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789762889.531268:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254915968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762889.531273:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762889.531288:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254916224:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789762889.531300:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42320448 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762889.531300:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789762889.531311:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254916352:12345-0@lo:400:kworker.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762889.531315:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254916480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762889.531327:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789762889.531333:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254916224:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762889.531340:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789762889.531358:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254915968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762889.531365:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254916480:12345-0@lo:400:kworker.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762889.531367:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762889.531368:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789762889.531375:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762889.531380:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789762889.531381:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762889.531400:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762889.531418:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254916480:0@lo:400:kworker.0 00000100:00100000:2.0:1789762889.531429:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254916224:0@lo:400:kworker.0 00000100:00100000:0.0:1789762889.531444:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254916352:0@lo:400:kworker.0 00000100:00100000:3.0:1789762889.531450:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916096 00000100:00100000:2.0:1789762889.531451:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254915712:0@lo:400:kworker.0 00000100:00100000:1.0:1789762889.531452:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254915968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762889.531458:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916096 00000100:00080000:0.0:1789762889.531492:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762889.531505:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789762889.531514:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254916096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762889.531556:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254916096:12345-0@lo:400:kworker.0 Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762889.531563:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789762889.531577:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254916096:0@lo:400:kworker.0 00010000:00010000:3.0:1789762889.594865:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762889.709044:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192146122479 time 192146282330 state 0x0 ref 1 00000100:00100000:3.0:1789762889.709076:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246573312:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762889.709124:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 96468992, mtime: 0x6aad9d49, atime: 0x6aad9d37, ctime: 0x6aad9d49, blocks: 0x2e000 00010000:00010000:3.0:1789762889.709132:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.709146:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=192s v=(0 0) 00010000:00010000:3.0:1789762889.709149:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762889.709154:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762889.709182:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762889.713789:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967521 is committed 00002000:00010000:0.0:1789762889.713848:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:0.0:1789762889.713853:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 188416 -> 190464 00010000:00010000:0.0:1789762889.713862:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.713882:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.713889:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.713894:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762889.713897:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.713903:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.713916:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.713922:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a511 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762889.713987:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246573312:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4927us (197895us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789762889.713996:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:0.0:1789762889.714002:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192146122479 time 192146282330 state 0x2 ref 0 00000100:00100000:3.0:1789762889.716215:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762889.716264:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573440 00000100:00100000:1.0:1789762889.716272:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573440 00000100:00100000:1.0:1789762889.716307:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192146122479 time 192146282330 state 0x0 ref 1 00000100:00100000:1.0:1789762889.716316:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192346282330 time 192146282330 state 0x1 ref 1 00000100:00100000:0.0:1789762889.909180:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192346282330 time 192346417419 state 0x0 ref 1 00000100:00100000:0.0:1789762889.909221:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246573440:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762889.909272:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 97517568, mtime: 0x6aad9d49, atime: 0x6aad9d37, ctime: 0x6aad9d49, blocks: 0x2e800 00010000:00010000:0.0:1789762889.909279:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.909294:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=192s v=(0 0) 00010000:00010000:0.0:1789762889.909297:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762889.909302:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.909314:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762889.914084:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967522 is committed 00002000:00010000:0.0:1789762889.914162:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:0.0:1789762889.914166:0:12138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762889 -> 1789762890 00002000:00010000:0.0:1789762889.914168:0:12138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762889 -> 1789762890 00002000:00010000:0.0:1789762889.914170:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 190464 -> 192512 00010000:00010000:0.0:1789762889.914178:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.914187:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.914194:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.914209:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762889.914212:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.914219:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.914232:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762889.914237:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a518 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762889.914293:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246573440:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5081us (198079us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789762889.914300:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:0.0:1789762889.914304:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192346282330 time 192346417419 state 0x2 ref 0 00000100:00100000:3.0:1789762889.916515:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762889.916566:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573568 00000100:00100000:1.0:1789762889.916574:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573568 00000100:00100000:1.0:1789762889.916607:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192346282330 time 192346417419 state 0x0 ref 1 00000100:00100000:1.0:1789762889.916616:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192546417419 time 192346417419 state 0x1 ref 1 00000100:00100000:2.0:1789762890.109312:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192546417419 time 192546549272 state 0x0 ref 1 00000100:00100000:2.0:1789762890.109341:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246573568:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762890.109396:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 98566144, mtime: 0x6aad9d4a, atime: 0x6aad9d37, ctime: 0x6aad9d4a, blocks: 0x2f000 00010000:00010000:2.0:1789762890.109403:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.109429:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=192s v=(0 0) 00010000:00010000:2.0:1789762890.109433:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762890.109437:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.109452:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762890.114586:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967523 is committed 00002000:00010000:2.0:1789762890.114655:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:2.0:1789762890.114661:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 192512 -> 194560 00010000:00010000:2.0:1789762890.114671:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.114682:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.114692:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.114700:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762890.114705:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.114715:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.114747:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.114778:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a51f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762890.114843:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246573568:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5514us (198327us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789762890.114853:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:2.0:1789762890.114860:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192546417419 time 192546549272 state 0x2 ref 0 00000100:00100000:3.0:1789762890.115636:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762890.115669:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762890.115680:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573696 00000100:00100000:2.0:1789762890.115690:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573696 00000100:00100000:3.0:1789762890.115708:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762890.115731:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573824 00000100:00100000:0.0:1789762890.115739:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573824 00000100:00100000:2.0:1789762890.115745:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 249 00000100:00100000:3.0:1789762890.115775:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762890.115793:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246573952 00000100:00100000:1.0:1789762890.115800:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246573952 00000100:00100000:3.0:1789762890.115806:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246574080 00000100:00100000:2.0:1789762890.115809:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246573696:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762890.115812:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246574080 00000100:00100000:0.0:1789762890.115824:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:0.0:1789762890.115836:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246573824:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762890.115847:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:3.0:1789762890.115861:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:1.0:1789762890.115862:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246573952:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762890.115868:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246573696:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 62us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762890.115879:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246574080:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762890.115880:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246573824:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 44us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762890.115888:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 249 00000100:00100000:1.0:1789762890.115901:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246573952:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 44us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762890.115914:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:0.0:1789762890.115920:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:3.0:1789762890.115922:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246574080:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762890.115931:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00080000:1.0:1789762890.115955:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762890.115961:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762890.117280:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762890.117318:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246574208 00000100:00100000:3.0:1789762890.117323:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246574208 00000100:00100000:3.0:1789762890.117346:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192546417419 time 192546549272 state 0x0 ref 1 00000100:00100000:3.0:1789762890.117354:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192746549272 time 192546549272 state 0x1 ref 1 00000100:00100000:2.0:1789762890.309491:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192746549272 time 192746728595 state 0x0 ref 1 00000100:00100000:2.0:1789762890.309524:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246574208:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762890.309578:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 99614720, mtime: 0x6aad9d4a, atime: 0x6aad9d37, ctime: 0x6aad9d4a, blocks: 0x2f800 00010000:00010000:2.0:1789762890.309587:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.309633:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=192s v=(0 0) 00010000:00010000:2.0:1789762890.309638:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762890.309644:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762890.309659:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762890.314611:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967524 is committed 00002000:00010000:1.0:1789762890.314670:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:1.0:1789762890.314676:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 194560 -> 196608 00010000:00010000:1.0:1789762890.314686:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.314700:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.314712:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.314719:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762890.314724:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.314733:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.314773:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.314783:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5a526 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.314860:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246574208:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5348us (197577us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789762890.314873:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 109 00000100:00100000:1.0:1789762890.314888:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192746549272 time 192746728595 state 0x2 ref 0 00000100:00100000:3.0:1789762890.317044:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762890.317086:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246574336 00000100:00100000:0.0:1789762890.317094:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246574336 00000100:00100000:0.0:1789762890.317129:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192746549272 time 192746728595 state 0x0 ref 1 00000100:00100000:0.0:1789762890.317138:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192946728595 time 192746728595 state 0x1 ref 1 00000100:00100000:3.0:1789762890.509640:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192946728595 time 192946865239 state 0x0 ref 1 00000100:00100000:3.0:1789762890.509669:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246574336:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762890.509729:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 100663296, mtime: 0x6aad9d4a, atime: 0x6aad9d37, ctime: 0x6aad9d4a, blocks: 0x30000 00010000:00010000:3.0:1789762890.509736:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.509790:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=192s v=(0 0) 00010000:00010000:3.0:1789762890.509796:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762890.509803:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.509818:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762890.514317:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967525 is committed 00002000:00010000:3.0:1789762890.514381:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:3.0:1789762890.514386:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 196608 -> 198656 00010000:00010000:3.0:1789762890.514395:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.514407:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.514416:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.514424:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762890.514429:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.514453:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.514467:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762890.514473:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a52d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762890.514528:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246574336:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4872us (197486us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789762890.514540:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:3.0:1789762890.514546:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192946728595 time 192946865239 state 0x2 ref 0 00000100:00100000:3.0:1789762890.516864:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762890.516925:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246574464 00000100:00100000:2.0:1789762890.516934:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246574464 00000100:00100000:2.0:1789762890.516985:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 192946728595 time 192946865239 state 0x0 ref 1 00000100:00100000:2.0:1789762890.516998:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193146865239 time 192946865239 state 0x1 ref 1 00010000:00010000:3.0:1789762890.618899:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762890.709802:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193146865239 time 193147037436 state 0x0 ref 1 00000100:00100000:1.0:1789762890.709838:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246574464:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762890.709896:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 101711872, mtime: 0x6aad9d4a, atime: 0x6aad9d37, ctime: 0x6aad9d4a, blocks: 0x30800 00010000:00010000:1.0:1789762890.709906:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.709921:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=193s v=(0 0) 00010000:00010000:1.0:1789762890.709926:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.709933:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.709950:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762890.714806:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967526 is committed 00002000:00010000:1.0:1789762890.714882:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:1.0:1789762890.714887:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 198656 -> 200704 00010000:00010000:1.0:1789762890.714897:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.714909:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.714918:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.714933:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762890.714938:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.714948:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.714983:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.714993:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a534 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.715060:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246574464:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5238us (198194us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789762890.715071:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:1.0:1789762890.715078:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193146865239 time 193147037436 state 0x2 ref 0 00000100:00100000:3.0:1789762890.717273:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762890.717312:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246574592 00000100:00100000:1.0:1789762890.717320:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246574592 00000100:00100000:1.0:1789762890.717357:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193146865239 time 193147037436 state 0x0 ref 1 00000100:00100000:1.0:1789762890.717370:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193347037436 time 193147037436 state 0x1 ref 1 00000100:00100000:1.0:1789762890.909920:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193347037436 time 193347156611 state 0x0 ref 1 00000100:00100000:1.0:1789762890.909954:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246574592:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762890.910054:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 102760448, mtime: 0x6aad9d4a, atime: 0x6aad9d37, ctime: 0x6aad9d4a, blocks: 0x31000 00010000:00010000:1.0:1789762890.910064:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.910082:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=193s v=(0 0) 00010000:00010000:1.0:1789762890.910087:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762890.910094:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.910109:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762890.914776:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967527 is committed 00002000:00010000:1.0:1789762890.914869:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:1.0:1789762890.914874:0:6916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789762890 -> 1789762891 00002000:00010000:1.0:1789762890.914876:0:6916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789762890 -> 1789762891 00002000:00010000:1.0:1789762890.914878:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 200704 -> 202752 00010000:00010000:1.0:1789762890.914887:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.914896:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.914902:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.914907:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762890.914917:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.914924:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.914938:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762890.914943:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a53b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762890.915017:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246574592:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5079us (197746us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789762890.915024:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:1.0:1789762890.915030:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193347037436 time 193347156611 state 0x2 ref 0 00000100:00100000:2.0:1789762890.917360:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762890.917413:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246574720 00000100:00100000:3.0:1789762890.917423:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246574720 00000100:00100000:3.0:1789762890.917463:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193347037436 time 193347156611 state 0x0 ref 1 00000100:00100000:3.0:1789762890.917475:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193547156611 time 193347156611 state 0x1 ref 1 00000100:00100000:3.0:1789762891.110043:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193547156611 time 193547278619 state 0x0 ref 1 00000100:00100000:3.0:1789762891.110091:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246574720:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:1.0:1789762891.110138:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762891.110173:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 103809024, mtime: 0x6aad9d4b, atime: 0x6aad9d37, ctime: 0x6aad9d4b, blocks: 0x31800 00010000:00010000:3.0:1789762891.110183:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.110198:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=193s v=(0 0) 00010000:00010000:3.0:1789762891.110202:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762891.110209:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.110223:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762891.114849:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967528 is committed 00002000:00010000:3.0:1789762891.114921:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:3.0:1789762891.114927:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 202752 -> 204800 00010000:00010000:3.0:1789762891.114937:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.114948:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.114958:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.114980:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762891.114985:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.115008:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.115026:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.115036:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a542 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762891.115100:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246574720:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5037us (197739us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789762891.115111:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:3.0:1789762891.115118:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193547156611 time 193547278619 state 0x2 ref 0 00000100:00100000:0.0:1789762891.116644:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762891.116689:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246574976 00000100:00100000:1.0:1789762891.116697:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246574976 00000100:00100000:1.0:1789762891.116737:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:1.0:1789762891.116745:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:11117:x1876702246574976:12345-192.168.203.36@tcp:35:dd.500 00000001:00080000:1.0:1789762891.116918:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000100:00100000:1.0:1789762891.116995:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11117:x1876702246574976:12345-192.168.203.36@tcp:35:dd.500 Request processed in 250us (352us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789762891.117001:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000020:00080000:1.0:1789762891.117004:0:5927:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789762891.163824:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762891.163902:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246575232 00000100:00100000:0.0:1789762891.163914:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246575232 00000100:00100000:0.0:1789762891.163987:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 144 00000100:00100000:0.0:1789762891.164012:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11135:x1876702246575232:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:0.0:1789762891.164040:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762891.164099:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5a549 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446db expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164192:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164208:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164221:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164253:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164282:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164291:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164479:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a55e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164491:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164499:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762891.164509:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 104857600 00010000:00010000:0.0:1789762891.164585:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164594:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164602:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164609:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762891.164614:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164623:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164647:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:0.0:1789762891.164650:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762891.164655:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164663:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164677:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164683:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164690:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164695:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762891.164698:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164705:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164713:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff9b33f721dd00) 00010000:00010000:0.0:1789762891.164715:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762891.164726:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164734:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164831:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5a549 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446db expref: 14 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164859:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a55e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446db expref: 13 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.164867:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:0.0:1789762891.164870:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762891.164873:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3055400, rc 0) 00000100:00100000:0.0:1789762891.164938:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:11135:x1876702246575232:12345-192.168.203.36@tcp:101:dd.500 Request processed in 930us (1121us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789762891.164947:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 144 00000100:00100000:2.0:1789762891.166307:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762891.166352:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246575360 00000100:00100000:0.0:1789762891.166358:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246575360 00000100:00100000:0.0:1789762891.166397:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:0.0:1789762891.166406:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246575360:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:0.0:1789762891.166416:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762891.166439:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a56c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446e2 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762891.166461:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 104857600, mtime: 0x6aad9d4b, atime: 0x6aad9d37, ctime: 0x6aad9d4b, blocks: 0x32000 00010000:00010000:0.0:1789762891.166475:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=193s v=(0 0) 00010000:00010000:0.0:1789762891.166480:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762891.166490:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a56c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446e2 expref: 6 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.166517:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a56c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446e2 expref: 6 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.166529:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054600, rc 0) 00000100:00100000:0.0:1789762891.166562:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246575360:12345-192.168.203.36@tcp:101:dd.500 Request processed in 157us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762891.166570:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:2.0:1789762891.168805:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762891.168855:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246575488 00000100:00100000:1.0:1789762891.168861:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246575488 00000100:00100000:1.0:1789762891.168896:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193547156611 time 193547278619 state 0x0 ref 1 00000100:00100000:1.0:1789762891.168908:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193747278619 time 193547278619 state 0x1 ref 1 00000100:00100000:0.0:1789762891.310159:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193747278619 time 193747396357 state 0x0 ref 1 00000100:00100000:0.0:1789762891.310189:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246575488:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762891.310227:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.310242:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762891.310245:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762891.310250:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.310261:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.314894:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.314907:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.314921:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.314927:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762891.314930:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.314936:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.314950:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762891.314956:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a573 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762891.315041:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246575488:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4864us (146234us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762891.315053:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:0.0:1789762891.315062:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193747278619 time 193747396357 state 0x2 ref 0 00000100:00100000:0.0:1789762891.317094:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762891.317138:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246575616 00000100:00100000:1.0:1789762891.317146:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246575616 00000100:00100000:1.0:1789762891.317179:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193747278619 time 193747396357 state 0x0 ref 1 00000100:00100000:1.0:1789762891.317188:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193947396357 time 193747396357 state 0x1 ref 1 00000100:00100000:2.0:1789762891.510271:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193947396357 time 193947508662 state 0x0 ref 1 00000100:00100000:2.0:1789762891.510301:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246575616:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762891.510339:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.510372:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762891.510375:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762891.510380:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.510391:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.513268:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.513279:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.513287:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.513292:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c553ca00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762891.513295:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.513301:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.513314:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.513329:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a57a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762891.513377:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246575616:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3090us (196284us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762891.513384:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:2.0:1789762891.513389:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193947396357 time 193947508662 state 0x2 ref 0 00000100:00100000:2.0:1789762891.515348:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762891.515395:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246575744 00000100:00100000:3.0:1789762891.515406:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246575744 00000100:00100000:3.0:1789762891.515444:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 193947396357 time 193947508662 state 0x0 ref 1 00000100:00100000:3.0:1789762891.515454:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194147508662 time 193947508662 state 0x1 ref 1 00000100:00100000:1.0:1789762891.578931:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762891.578952:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254916608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762891.579034:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762891.579077:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916608 00000100:00100000:0.0:1789762891.579085:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916608 00000100:00080000:1.0:1789762891.579121:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762891.579143:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789762891.579152:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254916608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762891.579193:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:0.0:1789762891.579235:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254916608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762891.579242:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789762891.579279:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254916608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762891.642886:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762891.710347:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194147508662 time 194147585809 state 0x0 ref 1 00000100:00100000:2.0:1789762891.710377:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246575744:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762891.710415:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.710430:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762891.710433:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762891.710438:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762891.710448:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.713478:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.713493:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.713502:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.713508:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c553ca00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762891.713512:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.713536:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.713549:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762891.713555:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061642db5/0x5915dfb1c1b5a581 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762891.713604:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246575744:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3238us (198252us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762891.713611:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:1.0:1789762891.713617:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194147508662 time 194147585809 state 0x2 ref 0 00000100:00100000:3.0:1789762891.715421:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762891.715461:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246575872 00000100:00100000:0.0:1789762891.715469:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246575872 00000100:00100000:0.0:1789762891.715500:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194147508662 time 194147585809 state 0x0 ref 1 00000100:00100000:0.0:1789762891.715508:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194347585809 time 194147585809 state 0x1 ref 1 00000100:00100000:3.0:1789762891.910462:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194347585809 time 194347700091 state 0x0 ref 1 00000100:00100000:3.0:1789762891.910490:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246575872:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762891.910527:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.910564:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762891.910569:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762891.910577:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.910591:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.913398:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.913407:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.913413:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.913418:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762891.913421:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.913427:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.913439:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762891.913454:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a588 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762891.913499:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246575872:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3021us (198077us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762891.913505:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:3.0:1789762891.913510:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194347585809 time 194347700091 state 0x2 ref 0 00000100:00100000:3.0:1789762891.915368:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762891.915440:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576000 00000100:00100000:2.0:1789762891.915455:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576000 00000100:00100000:2.0:1789762891.915491:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194347585809 time 194347700091 state 0x0 ref 1 00000100:00100000:2.0:1789762891.915503:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194547700091 time 194347700091 state 0x1 ref 1 00000100:00100000:1.0:1789762892.110572:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194547700091 time 194547811747 state 0x0 ref 1 00000100:00100000:1.0:1789762892.110596:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246576000:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762892.110632:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.110645:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.110649:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.110654:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.110665:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.113634:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.113645:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.113652:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.113657:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762892.113660:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.113667:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.113690:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.113695:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a58f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762892.113744:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246576000:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3157us (198376us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762892.113783:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:1.0:1789762892.113795:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194547700091 time 194547811747 state 0x2 ref 0 00000100:00100000:3.0:1789762892.115901:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762892.115936:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576128 00000100:00100000:1.0:1789762892.115944:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576128 00000100:00100000:1.0:1789762892.116133:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194547700091 time 194547811747 state 0x0 ref 1 00000100:00100000:1.0:1789762892.116152:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194747811747 time 194547811747 state 0x1 ref 1 00000100:00100000:1.0:1789762892.310671:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194747811747 time 194747909717 state 0x0 ref 1 00000100:00100000:1.0:1789762892.310700:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576128:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762892.310748:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.310789:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.310792:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762892.310798:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.310808:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.315209:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.315220:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.315227:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.315242:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762892.315245:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.315252:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.315267:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762892.315272:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a596 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762892.315331:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576128:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4646us (199431us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762892.315338:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:1.0:1789762892.315343:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194747811747 time 194747909717 state 0x2 ref 0 00000100:00100000:3.0:1789762892.317502:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762892.317562:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576256 00000100:00100000:1.0:1789762892.317570:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576256 00000100:00100000:1.0:1789762892.317601:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194747811747 time 194747909717 state 0x0 ref 1 00000100:00100000:1.0:1789762892.317610:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194947909717 time 194747909717 state 0x1 ref 1 00000100:00100000:3.0:1789762892.510820:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194947909717 time 194948056376 state 0x0 ref 1 00000100:00100000:3.0:1789762892.510854:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576256:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762892.510898:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762892.510918:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762892.510923:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762892.510931:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762892.510947:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.515139:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.515151:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.515162:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.515170:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762892.515175:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.515185:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.515202:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.515227:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5a59d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762892.515287:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576256:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4447us (197783us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762892.515298:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:0.0:1789762892.515314:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194947909717 time 194948056376 state 0x2 ref 0 00000100:00100000:2.0:1789762892.517353:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762892.517409:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576384 00000100:00100000:1.0:1789762892.517429:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576384 00000100:00100000:1.0:1789762892.517471:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 194947909717 time 194948056376 state 0x0 ref 1 00000100:00100000:1.0:1789762892.517491:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195148056376 time 194948056376 state 0x1 ref 1 00010000:00010000:3.0:1789762892.666915:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762892.711010:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195148056376 time 195148240217 state 0x0 ref 1 00000100:00100000:0.0:1789762892.711053:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246576384:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762892.711114:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.711138:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762892.711144:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762892.711152:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.711170:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.715168:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.715206:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.715239:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.715250:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762892.715258:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.715272:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.715297:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762892.715308:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a5a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762892.715444:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246576384:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4404us (198084us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762892.715460:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:0.0:1789762892.715471:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195148056376 time 195148240217 state 0x2 ref 0 00000100:00100000:0.0:1789762892.717627:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762892.717679:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576512 00000100:00100000:1.0:1789762892.717702:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576512 00000100:00100000:1.0:1789762892.717746:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195148056376 time 195148240217 state 0x0 ref 1 00000100:00100000:1.0:1789762892.717776:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195348240217 time 195148240217 state 0x1 ref 1 00000100:00100000:2.0:1789762892.911124:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195348240217 time 195348360454 state 0x0 ref 1 00000100:00100000:2.0:1789762892.911153:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576512:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762892.911190:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.911217:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762892.911220:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762892.911225:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.911235:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.914470:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.914481:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.914488:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.914507:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762892.914511:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.914517:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.914530:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762892.914535:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762892.914584:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576512:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3446us (196956us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762892.914591:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:2.0:1789762892.914596:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195348240217 time 195348360454 state 0x2 ref 0 00000100:00100000:3.0:1789762892.916535:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762892.916577:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576640 00000100:00100000:0.0:1789762892.916585:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576640 00000100:00100000:0.0:1789762892.916618:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195348240217 time 195348360454 state 0x0 ref 1 00000100:00100000:0.0:1789762892.916634:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195548360454 time 195348360454 state 0x1 ref 1 00000100:00100000:2.0:1789762893.111228:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195548360454 time 195548465696 state 0x0 ref 1 00000100:00100000:2.0:1789762893.111267:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246576640:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:1.0:1789762893.111301:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762893.111307:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.111322:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762893.111338:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762893.111344:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.111356:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.114204:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.114214:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.114221:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.114226:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762893.114229:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.114236:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.114249:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762893.114254:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a5b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762893.114314:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246576640:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3071us (197780us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762893.114322:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:2.0:1789762893.114327:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195548360454 time 195548465696 state 0x2 ref 0 00000100:00100000:3.0:1789762893.116227:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762893.116273:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576768 00000100:00100000:0.0:1789762893.116282:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576768 00000100:00100000:0.0:1789762893.116312:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195548360454 time 195548465696 state 0x0 ref 1 00000100:00100000:0.0:1789762893.116322:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195748465696 time 195548465696 state 0x1 ref 1 00000100:00100000:3.0:1789762893.311359:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195748465696 time 195748596072 state 0x0 ref 1 00000100:00100000:3.0:1789762893.311385:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576768:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762893.311422:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.311435:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762893.311439:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762893.311444:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762893.311466:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.314915:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.314931:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.314941:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.314959:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762893.314963:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.314971:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.314987:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.314994:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a5b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762893.315055:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246576768:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3680us (198826us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762893.315065:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:0.0:1789762893.315072:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195748465696 time 195748596072 state 0x2 ref 0 00000100:00100000:0.0:1789762893.317138:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762893.317178:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246576896 00000100:00100000:2.0:1789762893.317186:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246576896 00000100:00100000:2.0:1789762893.317219:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195748465696 time 195748596072 state 0x0 ref 1 00000100:00100000:2.0:1789762893.317227:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195948596072 time 195748596072 state 0x1 ref 1 00000100:00100000:1.0:1789762893.511541:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195948596072 time 195948779269 state 0x0 ref 1 00000100:00100000:1.0:1789762893.511571:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246576896:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762893.511609:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.511623:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.511627:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.511632:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.511655:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.517134:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.517155:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.517174:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.517179:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762893.517183:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.517190:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.517205:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.517210:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762893.517274:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246576896:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5715us (200133us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762893.517282:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:1.0:1789762893.517288:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195948596072 time 195948779269 state 0x2 ref 0 00000100:00100000:0.0:1789762893.519812:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762893.519871:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577024 00000100:00100000:2.0:1789762893.519882:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577024 00000100:00100000:2.0:1789762893.519930:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 195948596072 time 195948779269 state 0x0 ref 1 00000100:00100000:2.0:1789762893.519959:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196148779269 time 195948779269 state 0x1 ref 1 00010000:00010000:3.0:1789762893.690906:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762893.711676:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196148779269 time 196148913829 state 0x0 ref 1 00000100:00100000:1.0:1789762893.711704:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577024:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762893.711741:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.711797:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762893.711800:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762893.711806:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.711817:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.715431:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.715447:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.715458:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.715466:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762893.715470:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.715477:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.715491:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762893.715507:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762893.715559:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577024:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3867us (195750us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762893.715567:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:1.0:1789762893.715573:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196148779269 time 196148913829 state 0x2 ref 0 00000100:00100000:3.0:1789762893.717636:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762893.717683:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577152 00000100:00100000:0.0:1789762893.717691:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577152 00000100:00100000:0.0:1789762893.717722:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196148779269 time 196148913829 state 0x0 ref 1 00000100:00100000:0.0:1789762893.717731:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196348913829 time 196148913829 state 0x1 ref 1 00000100:00100000:0.0:1789762893.911800:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196348913829 time 196349038521 state 0x0 ref 1 00000100:00100000:0.0:1789762893.911830:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577152:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762893.911868:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.911882:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.911886:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762893.911890:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.911901:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.916016:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.916028:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.916045:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.916050:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762893.916054:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.916060:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.916072:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762893.916077:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762893.916136:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577152:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4320us (198502us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762893.916143:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:0.0:1789762893.916155:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196348913829 time 196349038521 state 0x2 ref 0 00000100:00100000:2.0:1789762893.919987:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762893.920046:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577280 00000100:00100000:1.0:1789762893.920055:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577280 00000100:00100000:1.0:1789762893.920091:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196348913829 time 196349038521 state 0x0 ref 1 00000100:00100000:1.0:1789762893.920109:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196549038521 time 196349038521 state 0x1 ref 1 00000100:00100000:0.0:1789762894.111921:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196549038521 time 196549148866 state 0x0 ref 1 00000100:00100000:0.0:1789762894.111963:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577280:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762894.112018:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.112032:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762894.112035:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762894.112040:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.112050:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.114804:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.114828:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.114837:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.114845:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762894.114861:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.114872:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.114901:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.114910:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a5d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762894.114991:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577280:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3053us (195007us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762894.115001:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:3.0:1789762894.115008:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196549038521 time 196549148866 state 0x2 ref 0 00000100:00100000:0.0:1789762894.117521:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762894.117601:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577408 00000100:00100000:1.0:1789762894.117611:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577408 00000100:00100000:1.0:1789762894.117651:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196549038521 time 196549148866 state 0x0 ref 1 00000100:00100000:1.0:1789762894.117660:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196749148866 time 196549148866 state 0x1 ref 1 00000100:00100000:2.0:1789762894.312036:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196749148866 time 196749274391 state 0x0 ref 1 00000100:00100000:2.0:1789762894.312067:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577408:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762894.312113:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762894.312131:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762894.312142:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762894.312149:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762894.312177:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.315319:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.315332:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.315342:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.315364:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762894.315369:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.315380:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.315396:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.315401:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316f46b1/0x5915dfb1c1b5a5dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762894.315455:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577408:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3401us (197933us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762894.315464:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:1.0:1789762894.315470:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196749148866 time 196749274391 state 0x2 ref 0 00000100:00100000:0.0:1789762894.317641:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762894.317690:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577536 00000100:00100000:3.0:1789762894.317700:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577536 00000100:00100000:3.0:1789762894.317737:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196749148866 time 196749274391 state 0x0 ref 1 00000100:00100000:3.0:1789762894.317781:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196949274391 time 196749274391 state 0x1 ref 1 00000100:00100000:2.0:1789762894.512180:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196949274391 time 196949415664 state 0x0 ref 1 00000100:00100000:2.0:1789762894.512213:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577536:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762894.512263:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762894.512277:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762894.512281:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762894.512285:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762894.512296:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.515519:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.515531:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.515538:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.515551:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d2d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762894.515555:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.515561:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.515574:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762894.515579:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000379ac12c/0x5915dfb1c1b5a5e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762894.515629:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577536:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3431us (197989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762894.515636:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 130 00000100:00100000:1.0:1789762894.515641:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196949274391 time 196949415664 state 0x2 ref 0 00000100:00100000:0.0:1789762894.517731:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762894.517784:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577664 00000100:00100000:3.0:1789762894.517793:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577664 00000100:00100000:3.0:1789762894.517853:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 196949274391 time 196949415664 state 0x0 ref 1 00000100:00100000:3.0:1789762894.517866:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197149415664 time 196949415664 state 0x1 ref 1 00000100:00100000:2.0:1789762894.650959:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254916864:0@lo:400:kworker.0 00000100:00100000:0.0:1789762894.650962:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254916992:0@lo:400:kworker.0 00000100:00100000:1.0:1789762894.650989:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254916736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762894.651025:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254917120:0@lo:400:kworker.0 00000100:00100000:0.0:1789762894.651041:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762894.651047:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762894.651057:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762894.651088:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762894.651122:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254917504:0@lo:400:kworker.0 00000100:00100000:1.0:1789762894.651125:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254917376:0@lo:400:kworker.0 00000100:00100000:2.0:1789762894.651125:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254917248:0@lo:400:kworker.0 00000100:00100000:3.0:1789762894.651136:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916992 00000100:00100000:3.0:1789762894.651143:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916992 00000100:00100000:0.0:1789762894.651160:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762894.651172:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762894.651193:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254917120 00000100:00100000:3.0:1789762894.651198:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254917120 00000100:00100000:2.0:1789762894.651201:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916864 00000100:00100000:2.0:1789762894.651205:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916864 00000100:00100000:3.0:1789762894.651238:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254917376 00000100:00100000:3.0:1789762894.651242:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254917376 00000100:00100000:0.0:1789762894.651243:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254917504 00000100:00100000:1.0:1789762894.651247:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254916736 00000100:00100000:0.0:1789762894.651249:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254917504 00000100:00100000:1.0:1789762894.651253:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254916736 00000100:00100000:2.0:1789762894.651254:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789762894.651267:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254916864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762894.651271:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789762894.651281:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254916992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762894.651303:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789762894.651308:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789762894.651316:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254917504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762894.651332:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254916736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762894.651332:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254916864:12345-0@lo:400:kworker.0 Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762894.651334:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254916992:12345-0@lo:400:kworker.0 Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762894.651347:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789762894.651347:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00002000:00000024:1.0:1789762894.651362:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42320448 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762894.651369:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254917504:12345-0@lo:400:kworker.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762894.651375:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789762894.651380:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789762894.651388:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254917120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762894.651393:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789762894.651409:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254916736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762894.651417:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254917376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762894.651422:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789762894.651431:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762894.651444:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254917120:12345-0@lo:400:kworker.0 Request processed in 58us (354us total) trans 0 rc 0/0 00000100:00080000:1.0:1789762894.651451:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762894.651455:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789762894.651458:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762894.651469:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254917376:12345-0@lo:400:kworker.0 Request processed in 59us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762894.651477:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789762894.651483:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254916864:0@lo:400:kworker.0 00000100:00100000:1.0:1789762894.651491:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254917376:0@lo:400:kworker.0 00000100:00100000:3.0:1789762894.651508:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254917120:0@lo:400:kworker.0 00000100:00100000:2.0:1789762894.651520:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254917248 00000100:00100000:1.0:1789762894.651521:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254916736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762894.651526:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254917248 00000100:00100000:0.0:1789762894.651542:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254917504:0@lo:400:kworker.0 00000100:00100000:0.0:1789762894.651563:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254916992:0@lo:400:kworker.0 00000100:00100000:2.0:1789762894.651570:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789762894.651570:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762894.651579:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254917248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762894.651626:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254917248:12345-0@lo:400:kworker.0 Request processed in 47us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762894.651633:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789762894.651639:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254917248:0@lo:400:kworker.0 00000100:00100000:0.0:1789762894.712280:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197149415664 time 197149519016 state 0x0 ref 1 00000100:00100000:0.0:1789762894.712309:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577664:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762894.712345:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.712360:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762894.712364:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762894.712368:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.712381:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.714894:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762894.716108:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.716119:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.716125:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.716137:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4f8b000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762894.716140:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.716147:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.716160:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.716165:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000307ee3ec/0x5915dfb1c1b5a5ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762894.716213:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577664:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3918us (198483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762894.716221:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:3.0:1789762894.716226:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197149415664 time 197149519016 state 0x2 ref 0 00000100:00100000:3.0:1789762894.718216:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762894.718267:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577792 00000100:00100000:1.0:1789762894.718273:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577792 00000100:00100000:1.0:1789762894.718305:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197149415664 time 197149519016 state 0x0 ref 1 00000100:00100000:1.0:1789762894.718314:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197349519016 time 197149519016 state 0x1 ref 1 00000100:00100000:3.0:1789762894.912389:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197349519016 time 197349626329 state 0x0 ref 1 00000100:00100000:3.0:1789762894.912417:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577792:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762894.912457:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.912496:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762894.912501:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762894.912507:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762894.912519:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.915453:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.915489:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.915499:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.915507:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762894.915512:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.915522:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.915541:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762894.915550:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a5f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762894.915620:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246577792:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3214us (197401us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762894.915630:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:0.0:1789762894.915637:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197349519016 time 197349626329 state 0x2 ref 0 00000100:00100000:2.0:1789762894.917744:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762894.917792:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246577920 00000100:00100000:1.0:1789762894.917801:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246577920 00000100:00100000:1.0:1789762894.917844:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197349519016 time 197349626329 state 0x0 ref 1 00000100:00100000:1.0:1789762894.917853:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197549626329 time 197349626329 state 0x1 ref 1 00000100:00100000:1.0:1789762895.112453:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197549626329 time 197549689141 state 0x0 ref 1 00000100:00100000:1.0:1789762895.112515:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577920:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:3.0:1789762895.112553:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762895.112554:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.112571:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762895.112585:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762895.112590:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.112602:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.115581:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.115592:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.115600:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.115605:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762895.115608:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.115614:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.115627:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.115632:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a5f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762895.115691:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246577920:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3220us (197947us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762895.115700:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 133 00000100:00100000:1.0:1789762895.115705:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197549626329 time 197549689141 state 0x2 ref 0 00000100:00100000:0.0:1789762895.118110:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762895.118155:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578048 00000100:00100000:3.0:1789762895.118164:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578048 00000100:00100000:3.0:1789762895.118194:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197549626329 time 197549689141 state 0x0 ref 1 00000100:00100000:3.0:1789762895.118202:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197749689141 time 197549689141 state 0x1 ref 1 00000100:00100000:2.0:1789762895.235876:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762895.235946:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578176 00000100:00100000:0.0:1789762895.235956:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578176 00000100:00100000:2.0:1789762895.235979:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762895.236009:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 251 00000100:00100000:0.0:1789762895.236020:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246578176:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762895.236045:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578304 00000100:00100000:1.0:1789762895.236052:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578304 00000100:00100000:0.0:1789762895.236083:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246578176:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 65us (217us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762895.236088:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762895.236089:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 251 00000100:00100000:1.0:1789762895.236110:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:1.0:1789762895.236121:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246578304:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762895.236159:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246578304:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762895.236164:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:0.0:1789762895.237890:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762895.237947:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578560 00000100:00100000:2.0:1789762895.237952:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578560 00000100:00080000:3.0:1789762895.237995:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762895.238000:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:2.0:1789762895.238009:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246578560:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762895.238043:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762895.238047:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246578560:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762895.238057:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:1.0:1789762895.238090:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578432 00000100:00100000:1.0:1789762895.238095:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578432 00000100:00100000:1.0:1789762895.238130:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:1.0:1789762895.238137:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2352:x1876702246578432:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:1.0:1789762895.238153:0:6912:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5915dfb1c1b59f45 00000100:00080000:3.0:1789762895.238154:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762895.238164:0:6912:0:(import.c:65:import_set_state_nolock()) ffff9b32c547b000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789762895.238200:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789762895.238211:0:6912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1789762895.238385:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+2:2352:x1876702246578432:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 248us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762895.238391:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:2.0:1789762895.312615:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197749689141 time 197749850876 state 0x0 ref 1 00000100:00100000:2.0:1789762895.312649:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246578048:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762895.312689:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762895.312706:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762895.312711:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762895.312718:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762895.312733:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.315913:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.315996:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.316003:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.316018:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c231c400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762895.316022:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.316028:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.316042:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.316047:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdfb4ea2/0x5915dfb1c1b5a5ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762895.316109:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246578048:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3477us (198000us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762895.316117:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 134 00000100:00100000:1.0:1789762895.316122:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197749689141 time 197749850876 state 0x2 ref 0 00000100:00100000:0.0:1789762895.318506:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762895.318557:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578688 00000100:00100000:3.0:1789762895.318565:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578688 00000100:00100000:3.0:1789762895.318601:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197749689141 time 197749850876 state 0x0 ref 1 00000100:00100000:3.0:1789762895.318613:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197949850876 time 197749850876 state 0x1 ref 1 00000100:00100000:3.0:1789762895.512706:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197949850876 time 197949943649 state 0x0 ref 1 00000100:00100000:3.0:1789762895.512735:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246578688:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762895.512807:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762895.512834:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762895.512838:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762895.512843:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762895.512855:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.515915:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.515949:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.515959:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.515968:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d31e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762895.515972:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.515982:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.516000:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.516009:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f9e6459/0x5915dfb1c1b5a606 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762895.516067:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246578688:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3344us (197560us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762895.516077:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 135 00000100:00100000:1.0:1789762895.516084:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197949850876 time 197949943649 state 0x2 ref 0 00000100:00100000:3.0:1789762895.517979:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762895.518020:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578816 00000100:00100000:1.0:1789762895.518035:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578816 00000100:00100000:1.0:1789762895.518073:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 197949850876 time 197949943649 state 0x0 ref 1 00000100:00100000:1.0:1789762895.518085:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198149943649 time 197949943649 state 0x1 ref 1 00000100:00100000:1.0:1789762895.712807:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198149943649 time 198150042853 state 0x0 ref 1 00000100:00100000:1.0:1789762895.712848:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246578816:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762895.712891:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.712908:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762895.712914:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762895.712921:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.712951:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.715745:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.715787:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.715798:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.715822:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762895.715827:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.715838:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.715855:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.715865:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a60d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762895.715920:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246578816:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3095us (197940us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762895.715942:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:1.0:1789762895.715949:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198149943649 time 198150042853 state 0x2 ref 0 00000100:00100000:3.0:1789762895.717844:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762895.717882:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246578944 00000100:00100000:1.0:1789762895.717890:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246578944 00000100:00100000:1.0:1789762895.717924:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198149943649 time 198150042853 state 0x0 ref 1 00000100:00100000:1.0:1789762895.717948:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198350042853 time 198150042853 state 0x1 ref 1 00010000:00010000:3.0:1789762895.738894:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762895.912918:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198350042853 time 198350155009 state 0x0 ref 1 00000100:00100000:1.0:1789762895.912972:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246578944:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762895.913036:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.913051:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762895.913056:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762895.913062:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.913078:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.916094:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.916109:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.916117:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.916122:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762895.916126:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.916132:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.916157:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762895.916163:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a614 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762895.916213:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246578944:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3268us (198369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762895.916219:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:1.0:1789762895.916225:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198350042853 time 198350155009 state 0x2 ref 0 00000100:00100000:3.0:1789762895.918419:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762895.918452:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579072 00000100:00100000:1.0:1789762895.918459:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579072 00000100:00100000:1.0:1789762895.918490:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198350042853 time 198350155009 state 0x0 ref 1 00000100:00100000:1.0:1789762895.918498:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198550155009 time 198350155009 state 0x1 ref 1 00000100:00100000:3.0:1789762896.113007:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198550155009 time 198550243606 state 0x0 ref 1 00000100:00100000:3.0:1789762896.113035:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579072:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762896.113074:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.113088:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.113091:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.113097:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.113108:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.116396:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.116410:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.116418:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.116423:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762896.116427:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.116434:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.116447:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.116452:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a61b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762896.116513:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579072:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3488us (198113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762896.116525:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 138 00000100:00100000:3.0:1789762896.116539:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198550155009 time 198550243606 state 0x2 ref 0 00000100:00100000:3.0:1789762896.118525:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762896.118573:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579200 00000100:00100000:1.0:1789762896.118582:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579200 00000100:00100000:1.0:1789762896.118615:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198550155009 time 198550243606 state 0x0 ref 1 00000100:00100000:1.0:1789762896.118624:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198750243606 time 198550243606 state 0x1 ref 1 00000100:00100000:3.0:1789762896.313160:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198750243606 time 198750398701 state 0x0 ref 1 00000100:00100000:3.0:1789762896.313190:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579200:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762896.313228:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.313241:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.313255:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.313261:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.313273:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.315974:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.315985:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.315992:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.315997:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762896.316001:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.316020:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.316038:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.316047:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a622 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762896.316098:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579200:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2923us (197573us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762896.316106:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 139 00000100:00100000:3.0:1789762896.316110:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198750243606 time 198750398701 state 0x2 ref 0 00000100:00100000:3.0:1789762896.318008:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762896.318054:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579328 00000100:00100000:1.0:1789762896.318063:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579328 00000100:00100000:1.0:1789762896.318095:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198750243606 time 198750398701 state 0x0 ref 1 00000100:00100000:1.0:1789762896.318104:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198950398701 time 198750398701 state 0x1 ref 1 00000100:00100000:3.0:1789762896.513274:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198950398701 time 198950512011 state 0x0 ref 1 00000100:00100000:3.0:1789762896.513302:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579328:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762896.513337:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.513352:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.513355:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.513361:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.513395:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.516347:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.516358:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.516364:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.516369:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762896.516373:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.516379:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.516392:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.516396:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a629 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762896.516462:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579328:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3171us (198453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762896.516470:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 140 00000100:00100000:3.0:1789762896.516476:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198950398701 time 198950512011 state 0x2 ref 0 00000100:00100000:3.0:1789762896.518354:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762896.518399:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579456 00000100:00100000:0.0:1789762896.518407:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579456 00000100:00100000:0.0:1789762896.518439:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 198950398701 time 198950512011 state 0x0 ref 1 00000100:00100000:0.0:1789762896.518448:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199150512011 time 198950512011 state 0x1 ref 1 00000100:00100000:3.0:1789762896.698977:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254917632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762896.699050:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762896.699098:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254917632 00000100:00100000:0.0:1789762896.699107:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254917632 00000100:00080000:1.0:1789762896.699149:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762896.699166:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789762896.699175:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254917632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762896.699201:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:0.0:1789762896.699247:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254917632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762896.699253:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789762896.699304:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254917632:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789762896.699763:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000100:00100000:2.0:1789762896.713343:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199150512011 time 199150583448 state 0x0 ref 1 00000100:00100000:2.0:1789762896.713363:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579456:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762896.713391:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.713405:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762896.713409:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762896.713413:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.713425:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.716342:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.716357:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.716366:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.716372:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762896.716375:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.716382:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.716396:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762896.716401:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5a630 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762896.716444:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579456:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3087us (198090us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762896.716452:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:2.0:1789762896.716463:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199150512011 time 199150583448 state 0x2 ref 0 00000100:00100000:0.0:1789762896.718440:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762896.718489:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579584 00000100:00100000:3.0:1789762896.718497:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579584 00000100:00100000:3.0:1789762896.718531:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199150512011 time 199150583448 state 0x0 ref 1 00000100:00100000:3.0:1789762896.718540:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199350583448 time 199150583448 state 0x1 ref 1 00010000:00010000:2.0:1789762896.762966:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762896.913411:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199350583448 time 199350649279 state 0x0 ref 1 00000100:00100000:3.0:1789762896.913439:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579584:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762896.913476:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.913491:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.913495:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762896.913500:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.913527:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.916524:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.916536:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.916543:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.916548:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762896.916552:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.916558:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.916571:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762896.916576:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a637 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762896.916634:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579584:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3208us (198196us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762896.916642:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:3.0:1789762896.916647:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199350583448 time 199350649279 state 0x2 ref 0 00000100:00100000:2.0:1789762896.918797:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762896.918824:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579712 00000100:00100000:3.0:1789762896.918833:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579712 00000100:00100000:3.0:1789762896.918864:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199350583448 time 199350649279 state 0x0 ref 1 00000100:00100000:3.0:1789762896.918873:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199550649279 time 199350649279 state 0x1 ref 1 00000100:00100000:1.0:1789762897.113501:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199550649279 time 199550739484 state 0x0 ref 1 00000100:00100000:1.0:1789762897.113546:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579712:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:3.0:1789762897.113566:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762897.113585:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.113600:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762897.113603:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762897.113608:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.113619:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.116178:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.116193:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.116204:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.116212:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762897.116217:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.116234:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.116253:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.116261:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a63e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762897.116313:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579712:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2792us (197513us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762897.116320:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 143 00000100:00100000:1.0:1789762897.116325:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199550649279 time 199550739484 state 0x2 ref 0 00000100:00100000:0.0:1789762897.118336:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762897.118390:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579840 00000100:00100000:2.0:1789762897.118399:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579840 00000100:00100000:2.0:1789762897.118445:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199550649279 time 199550739484 state 0x0 ref 1 00000100:00100000:2.0:1789762897.118458:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199750739484 time 199550739484 state 0x1 ref 1 00000100:00100000:1.0:1789762897.313646:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199750739484 time 199750880011 state 0x0 ref 1 00000100:00100000:1.0:1789762897.313682:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579840:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762897.313726:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.313747:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762897.313794:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762897.313802:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.313843:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.316686:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.316701:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.316711:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.316720:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762897.316725:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.316737:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.316777:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.316788:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a645 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762897.316862:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246579840:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3197us (198524us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762897.316874:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 144 00000100:00100000:1.0:1789762897.316881:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199750739484 time 199750880011 state 0x2 ref 0 00000100:00100000:0.0:1789762897.318856:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762897.318901:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246579968 00000100:00100000:3.0:1789762897.318909:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246579968 00000100:00100000:3.0:1789762897.318961:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199750739484 time 199750880011 state 0x0 ref 1 00000100:00100000:3.0:1789762897.318975:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199950880011 time 199750880011 state 0x1 ref 1 00000100:00100000:0.0:1789762897.513808:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199950880011 time 199950996631 state 0x0 ref 1 00000100:00100000:0.0:1789762897.513896:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579968:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762897.513956:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.513975:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762897.513979:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762897.513984:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.513996:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.516899:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.516910:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.516936:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.516942:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c231f600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762897.516946:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.516953:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.516975:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762897.516981:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f2b011/0x5915dfb1c1b5a64c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762897.517030:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246579968:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3187us (198174us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762897.517039:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 145 00000100:00100000:0.0:1789762897.517046:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199950880011 time 199950996631 state 0x2 ref 0 00000100:00100000:0.0:1789762897.519359:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762897.519401:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580096 00000100:00100000:1.0:1789762897.519410:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580096 00000100:00100000:1.0:1789762897.519443:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 199950880011 time 199950996631 state 0x0 ref 1 00000100:00100000:1.0:1789762897.519452:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200150996631 time 199950996631 state 0x1 ref 1 00000100:00100000:3.0:1789762897.713874:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200150996631 time 200151111209 state 0x0 ref 1 00000100:00100000:3.0:1789762897.713904:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580096:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762897.713952:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.713967:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762897.713971:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762897.713976:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.714002:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.717020:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.717034:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.717045:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.717054:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762897.717060:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.717070:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.717089:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762897.717096:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762897.717153:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580096:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3263us (197795us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762897.717160:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:3.0:1789762897.717166:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200150996631 time 200151111209 state 0x2 ref 0 00000100:00100000:2.0:1789762897.719191:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762897.719250:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580224 00000100:00100000:1.0:1789762897.719258:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580224 00000100:00100000:1.0:1789762897.719291:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200150996631 time 200151111209 state 0x0 ref 1 00000100:00100000:1.0:1789762897.719300:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200351111209 time 200151111209 state 0x1 ref 1 00010000:00010000:3.0:1789762897.786986:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762897.913996:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200351111209 time 200351233334 state 0x0 ref 1 00000100:00100000:1.0:1789762897.914025:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580224:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762897.914069:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.914089:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762897.914093:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762897.914098:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.914128:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.916938:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.916952:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.916961:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.916968:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762897.916972:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.916979:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.916992:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762897.916997:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a65a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762897.917057:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580224:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3045us (197866us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762897.917068:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:1.0:1789762897.917076:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200351111209 time 200351233334 state 0x2 ref 0 00000100:00100000:2.0:1789762897.919479:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762897.919558:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580352 00000100:00100000:0.0:1789762897.919566:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580352 00000100:00100000:0.0:1789762897.919600:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200351111209 time 200351233334 state 0x0 ref 1 00000100:00100000:0.0:1789762897.919610:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200551233334 time 200351233334 state 0x1 ref 1 00000100:00100000:2.0:1789762898.114087:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200551233334 time 200551326048 state 0x0 ref 1 00000100:00100000:2.0:1789762898.114112:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580352:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762898.114149:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762898.114163:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762898.114167:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762898.114171:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762898.114182:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.117525:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.117536:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.117542:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.117547:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762898.117551:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.117557:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.117570:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.117574:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5a661 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762898.117630:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580352:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3528us (198151us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762898.117637:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 148 00000100:00100000:1.0:1789762898.117643:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200551233334 time 200551326048 state 0x2 ref 0 00000100:00100000:0.0:1789762898.119703:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762898.119745:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580480 00000100:00100000:3.0:1789762898.119769:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580480 00000100:00100000:3.0:1789762898.119802:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200551233334 time 200551326048 state 0x0 ref 1 00000100:00100000:3.0:1789762898.119811:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200751326048 time 200551326048 state 0x1 ref 1 00000100:00100000:3.0:1789762898.314163:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200751326048 time 200751401706 state 0x0 ref 1 00000100:00100000:3.0:1789762898.314192:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580480:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762898.314229:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.314244:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762898.314247:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762898.314252:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.314262:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.317208:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.317229:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.317240:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.317247:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762898.317252:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.317263:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.317282:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.317288:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a668 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762898.317335:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580480:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3158us (197634us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762898.317343:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 149 00000100:00100000:3.0:1789762898.317348:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200751326048 time 200751401706 state 0x2 ref 0 00000100:00100000:0.0:1789762898.319291:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762898.319363:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580608 00000100:00100000:1.0:1789762898.319372:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580608 00000100:00100000:1.0:1789762898.319405:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200751326048 time 200751401706 state 0x0 ref 1 00000100:00100000:1.0:1789762898.319413:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200951401706 time 200751401706 state 0x1 ref 1 00000100:00100000:1.0:1789762898.514236:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200951401706 time 200951474033 state 0x0 ref 1 00000100:00100000:1.0:1789762898.514285:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580608:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762898.514346:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.514365:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762898.514370:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762898.514376:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.514391:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.518412:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.518430:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.518437:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.518442:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762898.518445:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.518452:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.518466:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.518474:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a66f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762898.518530:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580608:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4259us (199239us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762898.518538:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 150 00000100:00100000:1.0:1789762898.518544:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200951401706 time 200951474033 state 0x2 ref 0 00000100:00100000:0.0:1789762898.520873:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762898.520915:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580736 00000100:00100000:1.0:1789762898.520930:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580736 00000100:00100000:1.0:1789762898.520992:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 200951401706 time 200951474033 state 0x0 ref 1 00000100:00100000:1.0:1789762898.521004:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201151474033 time 200951474033 state 0x1 ref 1 00000100:00100000:1.0:1789762898.714330:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201151474033 time 201151567601 state 0x0 ref 1 00000100:00100000:1.0:1789762898.714358:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580736:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762898.714396:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.714418:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762898.714422:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762898.714427:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.714439:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.717589:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.717604:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.717614:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.717637:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762898.717643:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.717652:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.717666:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762898.717671:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a676 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762898.717720:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580736:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3375us (196849us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762898.717727:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:1.0:1789762898.717733:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201151474033 time 201151567601 state 0x2 ref 0 00000100:00100000:0.0:1789762898.719802:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762898.719855:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580864 00000100:00100000:3.0:1789762898.719870:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580864 00000100:00100000:3.0:1789762898.719900:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201151474033 time 201151567601 state 0x0 ref 1 00000100:00100000:3.0:1789762898.719921:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201351567601 time 201151567601 state 0x1 ref 1 00010000:00010000:2.0:1789762898.810948:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762898.914469:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201351567601 time 201351708373 state 0x0 ref 1 00000100:00100000:0.0:1789762898.914499:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580864:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762898.914544:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762898.914570:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762898.914574:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762898.914579:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762898.914590:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.917711:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.917722:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.917729:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.917735:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762898.917738:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.917744:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.917773:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762898.917779:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063386ac9/0x5915dfb1c1b5a67d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762898.917827:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246580864:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3343us (198026us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762898.917842:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 152 00000100:00100000:3.0:1789762898.917847:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201351567601 time 201351708373 state 0x2 ref 0 00000100:00100000:2.0:1789762898.919946:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762898.920003:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246580992 00000100:00100000:1.0:1789762898.920011:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246580992 00000100:00100000:1.0:1789762898.920058:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201351567601 time 201351708373 state 0x0 ref 1 00000100:00100000:1.0:1789762898.920068:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201551708373 time 201351708373 state 0x1 ref 1 00000100:00100000:3.0:1789762899.114574:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201551708373 time 201551813549 state 0x0 ref 1 00000100:00100000:3.0:1789762899.114618:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580992:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:1.0:1789762899.114643:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762899.114655:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.114670:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762899.114674:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762899.114679:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.114690:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762899.117633:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762899.117642:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762899.117649:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762899.117655:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762899.117658:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762899.117664:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762899.117677:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762899.117693:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf99f6/0x5915dfb1c1b5a684 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762899.117739:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246580992:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3149us (197795us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762899.117746:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 153 00000100:00100000:0.0:1789762899.117778:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201551708373 time 201551813549 state 0x2 ref 0 00000100:00100000:2.0:1789762899.119670:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762899.119722:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246581120 00000100:00100000:1.0:1789762899.119730:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246581120 00000100:00100000:1.0:1789762899.119794:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201551708373 time 201551813549 state 0x0 ref 1 00000100:00100000:1.0:1789762899.119804:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201751813549 time 201551813549 state 0x1 ref 1 00000100:00100000:1.0:1789762899.314660:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201751813549 time 201751899216 state 0x0 ref 1 00000100:00100000:1.0:1789762899.314686:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581120:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762899.314722:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.314737:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762899.314740:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762899.314745:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.314788:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.317538:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.317548:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.317555:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.317560:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762899.317573:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.317581:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.317593:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.317599:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a68b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762899.317653:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581120:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2976us (197981us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762899.317663:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 154 00000100:00100000:1.0:1789762899.317671:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201751813549 time 201751899216 state 0x2 ref 0 00000100:00100000:0.0:1789762899.319820:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762899.319862:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246581248 00000100:00100000:3.0:1789762899.319869:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246581248 00000100:00100000:3.0:1789762899.319911:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201751813549 time 201751899216 state 0x0 ref 1 00000100:00100000:3.0:1789762899.319920:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201951899216 time 201751899216 state 0x1 ref 1 00000100:00100000:2.0:1789762899.514879:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201951899216 time 201952110948 state 0x0 ref 1 00000100:00100000:2.0:1789762899.514945:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246581248:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762899.515003:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.515025:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762899.515031:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762899.515040:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.515059:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.520854:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.520876:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.520889:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.520924:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da5a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762899.520931:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.520963:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.520986:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762899.520997:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000118d9fac/0x5915dfb1c1b5a692 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762899.521082:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246581248:12345-192.168.203.36@tcp:3:dd.500 Request processed in 6178us (201258us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762899.521094:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:2.0:1789762899.521103:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201951899216 time 201952110948 state 0x2 ref 0 00000100:00100000:3.0:1789762899.524368:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762899.524468:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246581376 00000100:00100000:0.0:1789762899.524482:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246581376 00000100:00100000:0.0:1789762899.524535:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 201951899216 time 201952110948 state 0x0 ref 1 00000100:00100000:0.0:1789762899.524551:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202152110948 time 201952110948 state 0x1 ref 1 00000100:00100000:3.0:1789762899.715104:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202152110948 time 202152336478 state 0x0 ref 1 00000100:00100000:3.0:1789762899.715158:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581376:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762899.715252:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.715277:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762899.715283:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762899.715291:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.715312:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.720847:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.720868:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.720881:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.720891:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762899.720918:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.720931:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.720988:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762899.721005:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a699 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762899.721104:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581376:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5969us (196737us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762899.721119:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:3.0:1789762899.721128:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202152110948 time 202152336478 state 0x2 ref 0 00000100:00100000:3.0:1789762899.724538:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762899.724629:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246581504 00000100:00100000:1.0:1789762899.724643:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246581504 00000100:00100000:1.0:1789762899.724695:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202152110948 time 202152336478 state 0x0 ref 1 00000100:00100000:1.0:1789762899.724710:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202352336478 time 202152336478 state 0x1 ref 1 00000100:00100000:2.0:1789762899.771016:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254917760:0@lo:400:kworker.0 00000100:00100000:1.0:1789762899.771064:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254917888:0@lo:400:kworker.0 00000100:00100000:0.0:1789762899.771072:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762899.771115:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254918144:0@lo:400:kworker.0 00000100:00100000:2.0:1789762899.771132:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762899.771193:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762899.771205:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762899.771266:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254918272:0@lo:400:kworker.0 00000100:00100000:3.0:1789762899.771270:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254917760 00000100:00100000:0.0:1789762899.771272:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254918528:0@lo:400:kworker.0 00000100:00100000:3.0:1789762899.771287:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254917760 00000100:00100000:1.0:1789762899.771296:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254918400:0@lo:400:kworker.0 00000100:00100000:2.0:1789762899.771354:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762899.771374:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789762899.771380:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762899.771400:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254917760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762899.771405:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918016 00000100:00100000:0.0:1789762899.771419:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918016 00000100:00100000:2.0:1789762899.771479:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918272 00000100:00100000:1.0:1789762899.771488:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254917888 00000100:00100000:2.0:1789762899.771490:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918272 00000100:00100000:3.0:1789762899.771510:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254917760:12345-0@lo:400:kworker.0 Request processed in 114us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762899.771516:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254917888 00000100:00100000:0.0:1789762899.771532:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789762899.771543:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789762899.771557:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254918016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762899.771577:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789762899.771600:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254918272:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789762899.771601:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762899.771607:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918400 00000100:00100000:1.0:1789762899.771614:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918400 00000100:00100000:3.0:1789762899.771638:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762899.771684:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918144 00000100:00100000:1.0:1789762899.771691:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918144 00000100:00100000:0.0:1789762899.771717:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254918016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762899.771732:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789762899.771795:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789762899.771800:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254918272:12345-0@lo:400:kworker.0 Request processed in 152us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762899.771825:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789762899.771826:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254917888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762899.771837:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254918272:0@lo:400:kworker.0 00000100:00100000:3.0:1789762899.771873:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254917760:0@lo:400:kworker.0 00000100:00100000:0.0:1789762899.771888:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762899.771992:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789762899.771997:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254917888:12345-0@lo:400:kworker.0 Request processed in 180us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762899.772009:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762899.772026:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254918400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762899.772027:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789762899.772057:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789762899.772069:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254918144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762899.772120:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918528 00000100:00100000:1.0:1789762899.772130:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918528 00000100:00100000:2.0:1789762899.772133:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254918400:12345-0@lo:400:kworker.0 Request processed in 120us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762899.772150:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789762899.772163:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254918400:0@lo:400:kworker.0 00000100:00100000:3.0:1789762899.772197:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254918144:12345-0@lo:400:kworker.0 Request processed in 132us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762899.772204:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254917888:0@lo:400:kworker.0 00000100:00100000:1.0:1789762899.772207:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789762899.772208:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789762899.772221:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789762899.772232:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762899.772236:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789762899.772242:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254918528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762899.772321:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254918144:0@lo:400:kworker.0 00000100:00100000:1.0:1789762899.772332:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254918528:12345-0@lo:400:kworker.0 Request processed in 98us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762899.772345:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789762899.772399:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254918528:0@lo:400:kworker.0 00010000:00010000:1.0:1789762899.834962:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762899.915214:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202352336478 time 202352449399 state 0x0 ref 1 00000100:00100000:1.0:1789762899.915249:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246581504:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762899.915295:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.915314:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762899.915318:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762899.915325:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.915359:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.918669:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.918683:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.918692:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.918698:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762899.918702:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.918710:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.918725:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762899.918732:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762899.918828:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246581504:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3595us (194293us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762899.918837:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:1.0:1789762899.918844:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202352336478 time 202352449399 state 0x2 ref 0 00000100:00100000:3.0:1789762899.921079:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762899.921144:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246581632 00000100:00100000:2.0:1789762899.921152:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246581632 00000100:00100000:2.0:1789762899.921189:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202352336478 time 202352449399 state 0x0 ref 1 00000100:00100000:2.0:1789762899.921199:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202552449399 time 202352449399 state 0x1 ref 1 00000100:00100000:1.0:1789762900.115416:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202552449399 time 202552648784 state 0x0 ref 1 00000100:00100000:1.0:1789762900.115459:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581632:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762900.115515:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.115537:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762900.115543:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762900.115551:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.115569:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.120089:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.120109:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.120148:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.120158:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762900.120163:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.120175:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.120197:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762900.120208:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762900.120291:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581632:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4849us (199211us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762900.120311:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:1.0:1789762900.120324:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202552449399 time 202552648784 state 0x2 ref 0 00000100:00100000:3.0:1789762900.123818:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762900.123879:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246581760 00000100:00100000:1.0:1789762900.123922:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246581760 00000100:00100000:1.0:1789762900.123978:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202552449399 time 202552648784 state 0x0 ref 1 00000100:00100000:1.0:1789762900.123993:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202752648784 time 202552648784 state 0x1 ref 1 00000001:00100000:0.0:1789762900.283605:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:0.0:1789762900.283615:0:7983:0:(genops.c:885:class_export_put()) final put ffff9b32c547f800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:2.0:1789762900.283665:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b32c547f800/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 for lustre-OST0001 00000020:00000080:2.0:1789762900.283727:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b32c547b000 for lustre-OST0001 00000100:00100000:3.0:1789762900.315482:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202752648784 time 202752720993 state 0x0 ref 1 00000100:00100000:3.0:1789762900.315508:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246581760:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762900.315543:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.315557:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762900.315561:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762900.315566:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.315579:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.318209:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.318219:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.318226:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.318240:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762900.318243:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.318250:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.318262:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.318267:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d201cb3a/0x5915dfb1c1b5a6ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762900.318312:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246581760:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2815us (194501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762900.318319:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:3.0:1789762900.318324:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202752648784 time 202752720993 state 0x2 ref 0 00000100:00100000:3.0:1789762900.320312:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762900.320362:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246581888 00000100:00100000:1.0:1789762900.320369:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246581888 00000100:00100000:1.0:1789762900.320400:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202752648784 time 202752720993 state 0x0 ref 1 00000100:00100000:1.0:1789762900.320409:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202952720993 time 202752720993 state 0x1 ref 1 00000100:00100000:0.0:1789762900.355490:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762900.355519:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762900.355541:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582016 00000100:00100000:2.0:1789762900.355548:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582016 00000100:00100000:0.0:1789762900.355556:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762900.355592:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 253 00000100:00100000:1.0:1789762900.355607:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582144 00000100:00100000:2.0:1789762900.355607:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246582016:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762900.355608:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582272 00000100:00100000:1.0:1789762900.355614:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582144 00000100:00100000:3.0:1789762900.355615:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582272 00000100:00100000:2.0:1789762900.355665:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246582016:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762900.355666:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762900.355674:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:2.0:1789762900.355679:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 253 00000100:00100000:3.0:1789762900.355685:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:1.0:1789762900.355691:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246582144:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762900.355698:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246582272:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762900.355740:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246582144:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762900.355745:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246582272:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762900.355784:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:3.0:1789762900.355792:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:0.0:1789762900.515619:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202952720993 time 202952858026 state 0x0 ref 1 00000100:00100000:0.0:1789762900.515646:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581888:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762900.515682:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762900.515696:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762900.515700:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762900.515705:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762900.515716:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.518208:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.518219:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.518227:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.518232:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d73600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762900.518235:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.518242:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.518255:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.518260:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125e14e0/0x5915dfb1c1b5a6b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762900.518308:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246581888:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2675us (197996us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762900.518316:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:3.0:1789762900.518331:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202952720993 time 202952858026 state 0x2 ref 0 00000100:00100000:0.0:1789762900.520452:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762900.520506:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582400 00000100:00100000:1.0:1789762900.520514:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582400 00000100:00100000:1.0:1789762900.520546:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 202952720993 time 202952858026 state 0x0 ref 1 00000100:00100000:1.0:1789762900.520554:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203152858026 time 202952858026 state 0x1 ref 1 00000100:00100000:3.0:1789762900.715722:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203152858026 time 203152959970 state 0x0 ref 1 00000100:00100000:3.0:1789762900.715775:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246582400:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762900.715814:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.715829:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762900.715832:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762900.715837:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.715849:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.718786:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.718795:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.718801:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.718806:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762900.718809:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.718828:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.718841:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762900.718846:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762900.718903:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246582400:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3156us (198442us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762900.718911:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:3.0:1789762900.718916:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203152858026 time 203152959970 state 0x2 ref 0 00000100:00100000:2.0:1789762900.720917:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762900.720951:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582528 00000100:00100000:3.0:1789762900.720959:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582528 00000100:00100000:3.0:1789762900.720986:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203152858026 time 203152959970 state 0x0 ref 1 00000100:00100000:3.0:1789762900.720994:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203352959970 time 203152959970 state 0x1 ref 1 00010000:00010000:2.0:1789762900.858924:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762900.915864:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203352959970 time 203353094555 state 0x0 ref 1 00000100:00100000:2.0:1789762900.915926:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246582528:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762900.915965:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.915979:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762900.915984:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762900.915989:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.916000:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.918588:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.918597:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.918603:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.918608:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762900.918612:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.918618:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.918638:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762900.918644:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5a6c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762900.918689:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246582528:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2777us (197773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762900.918695:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:2.0:1789762900.918701:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203352959970 time 203353094555 state 0x2 ref 0 00000100:00100000:2.0:1789762900.920765:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762900.920802:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582656 00000100:00100000:3.0:1789762900.920810:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582656 00000100:00100000:3.0:1789762900.920841:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203352959970 time 203353094555 state 0x0 ref 1 00000100:00100000:3.0:1789762900.920850:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203553094555 time 203353094555 state 0x1 ref 1 00000100:00100000:3.0:1789762901.115961:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203553094555 time 203553197475 state 0x0 ref 1 00000100:00100000:3.0:1789762901.116030:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246582656:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:0.0:1789762901.116055:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762901.116067:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.116082:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762901.116085:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762901.116091:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.116106:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.119070:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.119081:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.119087:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.119093:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762901.119097:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.119107:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.119132:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.119141:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762901.119193:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246582656:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3183us (198443us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762901.119200:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 163 00000100:00100000:3.0:1789762901.119205:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203553094555 time 203553197475 state 0x2 ref 0 00000100:00100000:0.0:1789762901.121220:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762901.121253:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582784 00000100:00100000:3.0:1789762901.121261:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582784 00000100:00100000:3.0:1789762901.121290:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203553094555 time 203553197475 state 0x0 ref 1 00000100:00100000:3.0:1789762901.121299:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203753197475 time 203553197475 state 0x1 ref 1 00000100:00100000:1.0:1789762901.316048:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203753197475 time 203753286025 state 0x0 ref 1 00000100:00100000:1.0:1789762901.316077:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246582784:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762901.316118:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.316136:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762901.316141:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762901.316148:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.316178:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.318977:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.318988:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.318995:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.319000:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762901.319003:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.319010:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.319022:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.319027:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762901.319087:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246582784:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3024us (197866us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762901.319094:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:1.0:1789762901.319100:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203753197475 time 203753286025 state 0x2 ref 0 00000100:00100000:3.0:1789762901.320964:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762901.321000:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246582912 00000100:00100000:2.0:1789762901.321007:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246582912 00000100:00100000:2.0:1789762901.321038:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203753197475 time 203753286025 state 0x0 ref 1 00000100:00100000:2.0:1789762901.321046:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203953286025 time 203753286025 state 0x1 ref 1 00000100:00100000:1.0:1789762901.516182:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203953286025 time 203953420218 state 0x0 ref 1 00000100:00100000:1.0:1789762901.516213:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246582912:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762901.516249:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.516264:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762901.516268:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762901.516273:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.516284:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.519220:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.519231:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.519249:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.519254:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762901.519258:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.519264:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.519276:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762901.519281:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a6d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762901.519329:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246582912:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3131us (198365us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762901.519335:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:1.0:1789762901.519340:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203953286025 time 203953420218 state 0x2 ref 0 00000100:00100000:2.0:1789762901.521509:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762901.521556:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583040 00000100:00100000:3.0:1789762901.521565:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583040 00000100:00100000:3.0:1789762901.521595:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 203953286025 time 203953420218 state 0x0 ref 1 00000100:00100000:3.0:1789762901.521604:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204153420218 time 203953420218 state 0x1 ref 1 00000100:00100000:3.0:1789762901.716299:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204153420218 time 204153536543 state 0x0 ref 1 00000100:00100000:3.0:1789762901.716328:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583040:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762901.716380:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.716395:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762901.716398:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762901.716403:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.716415:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.719634:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.719648:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.719658:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.719667:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762901.719671:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.719680:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.719704:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.719710:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762901.719782:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583040:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3467us (198273us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762901.719789:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:3.0:1789762901.719794:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204153420218 time 204153536543 state 0x2 ref 0 00000100:00100000:2.0:1789762901.721875:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762901.721932:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583168 00000100:00100000:1.0:1789762901.721940:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583168 00000100:00100000:1.0:1789762901.721975:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204153420218 time 204153536543 state 0x0 ref 1 00000100:00100000:1.0:1789762901.721984:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204353536543 time 204153536543 state 0x1 ref 1 00000100:00100000:1.0:1789762901.818914:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762901.818945:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254918656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762901.819027:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762901.819092:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918656 00000100:00100000:0.0:1789762901.819102:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918656 00000100:00080000:2.0:1789762901.819168:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762901.819177:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789762901.819187:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254918656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762901.819213:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:0.0:1789762901.819256:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254918656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762901.819262:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789762901.819295:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254918656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789762901.882877:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762901.916410:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204353536543 time 204353648940 state 0x0 ref 1 00000100:00100000:3.0:1789762901.916439:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583168:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762901.916475:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.916489:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762901.916492:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762901.916497:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.916508:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.919187:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.919198:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.919205:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.919211:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762901.919214:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.919220:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.919233:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762901.919238:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762901.919283:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583168:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2858us (197409us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762901.919291:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:3.0:1789762901.919302:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204353536543 time 204353648940 state 0x2 ref 0 00000100:00100000:0.0:1789762901.921209:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762901.921252:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583296 00000100:00100000:1.0:1789762901.921261:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583296 00000100:00100000:1.0:1789762901.921291:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204353536543 time 204353648940 state 0x0 ref 1 00000100:00100000:1.0:1789762901.921300:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204553648940 time 204353648940 state 0x1 ref 1 00000100:00100000:0.0:1789762902.116496:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204553648940 time 204553734078 state 0x0 ref 1 00000100:00100000:0.0:1789762902.116524:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583296:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762902.116579:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762902.116593:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762902.116602:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762902.116607:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762902.116619:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.119321:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.119332:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.119339:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.119344:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c231e200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762902.119347:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.119353:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.119365:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.119370:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ba07a0/0x5915dfb1c1b5a6ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762902.119429:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583296:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2918us (198220us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762902.119436:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:3.0:1789762902.119448:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204553648940 time 204553734078 state 0x2 ref 0 00000100:00100000:3.0:1789762902.121349:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762902.121400:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583424 00000100:00100000:1.0:1789762902.121408:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583424 00000100:00100000:1.0:1789762902.121448:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204553648940 time 204553734078 state 0x0 ref 1 00000100:00100000:1.0:1789762902.121459:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204753734078 time 204553734078 state 0x1 ref 1 00000100:00100000:2.0:1789762902.316605:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204753734078 time 204753843601 state 0x0 ref 1 00000100:00100000:2.0:1789762902.316636:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583424:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762902.316674:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762902.316705:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762902.316709:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762902.316715:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762902.316731:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.319540:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.319552:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.319559:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.319564:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4f89800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762902.319567:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.319585:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.319599:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.319604:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeaba963/0x5915dfb1c1b5a6f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762902.319653:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583424:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3032us (198305us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762902.319660:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:1.0:1789762902.319665:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204753734078 time 204753843601 state 0x2 ref 0 00000100:00100000:3.0:1789762902.321608:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762902.321660:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583552 00000100:00100000:0.0:1789762902.321669:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583552 00000100:00100000:0.0:1789762902.321701:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204753734078 time 204753843601 state 0x0 ref 1 00000100:00100000:0.0:1789762902.321715:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204953843601 time 204753843601 state 0x1 ref 1 00000100:00100000:3.0:1789762902.516713:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204953843601 time 204953952286 state 0x0 ref 1 00000100:00100000:3.0:1789762902.516743:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583552:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762902.516814:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.516830:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762902.516834:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762902.516839:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.516850:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.519516:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.519527:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.519533:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.519538:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762902.519551:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.519558:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.519570:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762902.519575:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a353b29a/0x5915dfb1c1b5a6fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762902.519623:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583552:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2894us (198016us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762902.519630:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:3.0:1789762902.519634:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204953843601 time 204953952286 state 0x2 ref 0 00000100:00100000:3.0:1789762902.521804:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762902.522244:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583680 00000100:00100000:0.0:1789762902.522256:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583680 00000100:00100000:0.0:1789762902.522303:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 204953843601 time 204953952286 state 0x0 ref 1 00000100:00100000:0.0:1789762902.522316:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205153952286 time 204953952286 state 0x1 ref 1 00000100:00100000:2.0:1789762902.716815:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205153952286 time 205154053360 state 0x0 ref 1 00000100:00100000:2.0:1789762902.716844:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583680:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762902.716892:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762902.716906:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762902.716911:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762902.716918:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762902.716937:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.719947:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.719963:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.719973:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.719981:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762902.719985:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.720008:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.720022:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.720028:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5a702 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762902.720079:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583680:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3248us (198276us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762902.720085:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:1.0:1789762902.720090:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205153952286 time 205154053360 state 0x2 ref 0 00000100:00100000:3.0:1789762902.721967:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762902.722002:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583808 00000100:00100000:1.0:1789762902.722009:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583808 00000100:00100000:1.0:1789762902.722040:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205153952286 time 205154053360 state 0x0 ref 1 00000100:00100000:1.0:1789762902.722049:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205354053360 time 205154053360 state 0x1 ref 1 00010000:00010000:2.0:1789762902.906911:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762902.916894:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205354053360 time 205354116783 state 0x0 ref 1 00000100:00100000:1.0:1789762902.916922:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583808:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762902.916957:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.916987:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762902.916990:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762902.916995:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.917005:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.920497:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.920507:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.920515:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.920521:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762902.920524:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.920530:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.920543:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762902.920558:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a709 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762902.920606:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246583808:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3698us (198641us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762902.920613:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:1.0:1789762902.920618:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205354053360 time 205354116783 state 0x2 ref 0 00000100:00100000:3.0:1789762902.922558:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762902.922594:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246583936 00000100:00100000:1.0:1789762902.922602:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246583936 00000100:00100000:1.0:1789762902.922630:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205354053360 time 205354116783 state 0x0 ref 1 00000100:00100000:1.0:1789762902.922638:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205554116783 time 205354116783 state 0x1 ref 1 00000100:00100000:1.0:1789762903.116970:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205554116783 time 205554209110 state 0x0 ref 1 00000100:00100000:1.0:1789762903.117021:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583936:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:2.0:1789762903.117044:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762903.117061:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.117075:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762903.117079:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762903.117084:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.117094:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.120668:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.120686:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.120693:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.120698:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762903.120701:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.120708:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.120720:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.120725:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a710 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762903.120811:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246583936:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3825us (198253us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762903.120820:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:1.0:1789762903.120831:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205554116783 time 205554209110 state 0x2 ref 0 00000100:00100000:3.0:1789762903.122794:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762903.122840:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584064 00000100:00100000:1.0:1789762903.122848:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584064 00000100:00100000:1.0:1789762903.122896:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205554116783 time 205554209110 state 0x0 ref 1 00000100:00100000:1.0:1789762903.122908:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205754209110 time 205554209110 state 0x1 ref 1 00000100:00100000:0.0:1789762903.317088:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205754209110 time 205754326153 state 0x0 ref 1 00000100:00100000:0.0:1789762903.317118:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584064:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762903.317156:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.317170:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762903.317181:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762903.317186:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.317197:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.322044:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.322055:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.322062:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.322080:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762903.322084:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.322091:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.322104:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.322109:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5a717 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762903.322155:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584064:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5051us (199363us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762903.322162:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:3.0:1789762903.322168:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205754209110 time 205754326153 state 0x2 ref 0 00000100:00100000:3.0:1789762903.324583:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762903.324629:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584192 00000100:00100000:1.0:1789762903.324637:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584192 00000100:00100000:1.0:1789762903.324670:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205754209110 time 205754326153 state 0x0 ref 1 00000100:00100000:1.0:1789762903.324679:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205954326153 time 205754326153 state 0x1 ref 1 00000100:00100000:0.0:1789762903.517171:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205954326153 time 205954407665 state 0x0 ref 1 00000100:00100000:0.0:1789762903.517204:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584192:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762903.517244:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.517268:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762903.517272:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762903.517276:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.517288:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.520743:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.520778:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.520785:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.520790:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762903.520793:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.520799:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.520811:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762903.520828:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5a71e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762903.520890:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584192:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3699us (196306us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762903.520901:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:0.0:1789762903.520908:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205954326153 time 205954407665 state 0x2 ref 0 00000100:00100000:2.0:1789762903.522930:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762903.522988:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584320 00000100:00100000:1.0:1789762903.522997:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584320 00000100:00100000:1.0:1789762903.523030:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 205954326153 time 205954407665 state 0x0 ref 1 00000100:00100000:1.0:1789762903.523039:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206154407665 time 205954407665 state 0x1 ref 1 00000100:00100000:2.0:1789762903.717281:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206154407665 time 206154518246 state 0x0 ref 1 00000100:00100000:2.0:1789762903.717324:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584320:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762903.717380:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762903.717399:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762903.717404:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762903.717411:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762903.717429:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.720888:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.720899:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.720905:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.720910:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de4200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762903.720914:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.720928:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.720941:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762903.720946:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efda98b7/0x5915dfb1c1b5a725 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762903.720996:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584320:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3682us (198068us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762903.721002:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:1.0:1789762903.721008:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206154407665 time 206154518246 state 0x2 ref 0 00000100:00100000:2.0:1789762903.723320:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762903.723361:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584448 00000100:00100000:3.0:1789762903.723369:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584448 00000100:00100000:3.0:1789762903.723408:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206154407665 time 206154518246 state 0x0 ref 1 00000100:00100000:3.0:1789762903.723420:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206354518246 time 206154518246 state 0x1 ref 1 00000100:00100000:3.0:1789762903.917380:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206354518246 time 206354617778 state 0x0 ref 1 00000100:00100000:3.0:1789762903.917421:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584448:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762903.917458:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.917472:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762903.917476:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762903.917481:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.917492:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.921257:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.921267:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.921273:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.921277:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d31000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762903.921281:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.921287:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.921308:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762903.921317:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca9c7e38/0x5915dfb1c1b5a72c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762903.921372:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584448:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3958us (198052us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762903.921379:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:3.0:1789762903.921385:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206354518246 time 206354617778 state 0x2 ref 0 00000100:00100000:3.0:1789762903.923499:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762903.923541:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584576 00000100:00100000:0.0:1789762903.923549:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584576 00000100:00100000:0.0:1789762903.923581:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206354518246 time 206354617778 state 0x0 ref 1 00000100:00100000:0.0:1789762903.923590:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206554617778 time 206354617778 state 0x1 ref 1 00010000:00010000:1.0:1789762903.930840:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762904.117478:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206554617778 time 206554717225 state 0x0 ref 1 00000100:00100000:2.0:1789762904.117515:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584576:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762904.117561:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.117578:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762904.117582:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762904.117587:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.117598:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.120834:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.120845:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.120852:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.120857:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762904.120861:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.120886:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.120900:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762904.120905:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a733 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762904.120958:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584576:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3464us (197460us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762904.120964:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:2.0:1789762904.120975:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206554617778 time 206554717225 state 0x2 ref 0 00000100:00100000:0.0:1789762904.122974:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762904.123017:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584704 00000100:00100000:1.0:1789762904.123025:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584704 00000100:00100000:1.0:1789762904.123056:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206554617778 time 206554717225 state 0x0 ref 1 00000100:00100000:1.0:1789762904.123064:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206754717225 time 206554717225 state 0x1 ref 1 00000100:00100000:1.0:1789762904.317550:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206754717225 time 206754786776 state 0x0 ref 1 00000100:00100000:1.0:1789762904.317577:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584704:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762904.317616:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.317652:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762904.317656:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762904.317661:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.317673:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.321538:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.321549:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.321556:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.321562:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762904.321565:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.321571:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.321584:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.321601:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a73a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762904.321657:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584704:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4091us (198682us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762904.321664:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:1.0:1789762904.321670:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206754717225 time 206754786776 state 0x2 ref 0 00000100:00100000:0.0:1789762904.323814:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762904.323857:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584832 00000100:00100000:3.0:1789762904.323878:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584832 00000100:00100000:3.0:1789762904.323909:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206754717225 time 206754786776 state 0x0 ref 1 00000100:00100000:3.0:1789762904.323917:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206954786776 time 206754786776 state 0x1 ref 1 00000100:00100000:1.0:1789762904.517664:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206954786776 time 206954902735 state 0x0 ref 1 00000100:00100000:1.0:1789762904.517693:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584832:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762904.517732:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.517746:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762904.517782:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762904.517788:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.517800:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.522962:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.522984:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.522990:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.522995:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762904.522999:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.523006:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.523019:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762904.523023:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a741 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762904.523072:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246584832:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5392us (199258us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762904.523079:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:1.0:1789762904.523084:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206954786776 time 206954902735 state 0x2 ref 0 00000100:00100000:3.0:1789762904.526204:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762904.526297:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246584960 00000100:00100000:2.0:1789762904.526306:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246584960 00000100:00100000:2.0:1789762904.526339:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 206954786776 time 206954902735 state 0x0 ref 1 00000100:00100000:2.0:1789762904.526348:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207154902735 time 206954902735 state 0x1 ref 1 00000100:00100000:3.0:1789762904.717793:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207154902735 time 207155030311 state 0x0 ref 1 00000100:00100000:3.0:1789762904.717822:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584960:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762904.717857:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.717885:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762904.717901:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762904.717907:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.717921:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.721514:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.721525:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.721532:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.721537:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762904.721540:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.721547:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.721559:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.721564:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f95f069/0x5915dfb1c1b5a748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762904.721619:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246584960:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3811us (195416us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762904.721626:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:3.0:1789762904.721631:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207154902735 time 207155030311 state 0x2 ref 0 00000100:00100000:3.0:1789762904.724892:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762904.724955:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585088 00000100:00100000:1.0:1789762904.724969:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585088 00000100:00100000:1.0:1789762904.725001:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207154902735 time 207155030311 state 0x0 ref 1 00000100:00100000:1.0:1789762904.725010:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207355030311 time 207155030311 state 0x1 ref 1 00000100:00100000:2.0:1789762904.890900:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254918784:0@lo:400:kworker.0 00000100:00100000:1.0:1789762904.890902:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254918912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762904.890929:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254919040:0@lo:400:kworker.0 00000100:00100000:3.0:1789762904.890943:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254919168:0@lo:400:kworker.0 00000100:00100000:2.0:1789762904.890986:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762904.890989:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762904.891013:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762904.891037:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918912 00000100:00100000:0.0:1789762904.891044:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918912 00000100:00100000:1.0:1789762904.891058:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254919424:0@lo:400:kworker.0 00000100:00100000:2.0:1789762904.891059:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254919296:0@lo:400:kworker.0 00000100:00100000:3.0:1789762904.891069:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254918784 00000100:00100000:3.0:1789762904.891075:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254918784 00000100:00100000:0.0:1789762904.891108:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789762904.891113:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762904.891121:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762904.891122:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789762904.891123:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254918912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762904.891143:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254918784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762904.891153:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919296 00002000:00000024:0.0:1789762904.891157:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762904.891158:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919296 00000100:00080000:1.0:1789762904.891185:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762904.891191:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762904.891207:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762904.891214:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254918784:12345-0@lo:400:kworker.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762904.891220:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789762904.891223:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254918912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762904.891230:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789762904.891235:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254919296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762904.891236:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254919552:0@lo:400:kworker.0 00000100:00100000:0.0:1789762904.891237:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789762904.891276:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762904.891278:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919168 00000100:00100000:3.0:1789762904.891283:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919424 00000100:00100000:3.0:1789762904.891288:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919424 00000100:00100000:0.0:1789762904.891294:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919168 00000100:00100000:2.0:1789762904.891306:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254919296:12345-0@lo:400:kworker.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762904.891315:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789762904.891321:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919552 00000100:00100000:1.0:1789762904.891328:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919552 00000100:00100000:3.0:1789762904.891337:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919040 00000100:00100000:3.0:1789762904.891341:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919040 00000100:00100000:0.0:1789762904.891357:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789762904.891371:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254919424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762904.891372:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789762904.891378:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789762904.891383:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789762904.891389:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254919168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762904.891394:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254919552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762904.891398:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254919040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762904.891422:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254919424:12345-0@lo:400:kworker.0 Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762904.891430:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789762904.891451:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254919168:12345-0@lo:400:kworker.0 Request processed in 66us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762904.891457:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789762904.891468:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254919552:12345-0@lo:400:kworker.0 Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762904.891470:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254919040:12345-0@lo:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762904.891482:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254919424:0@lo:400:kworker.0 00000100:00100000:1.0:1789762904.891489:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789762904.891491:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789762904.891496:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254919296:0@lo:400:kworker.0 00000100:00100000:0.0:1789762904.891514:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254918912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762904.891517:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254918784:0@lo:400:kworker.0 00000100:00080000:3.0:1789762904.891540:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762904.891551:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254919040:0@lo:400:kworker.0 00000100:00100000:1.0:1789762904.891564:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254919552:0@lo:400:kworker.0 00000100:00100000:3.0:1789762904.891585:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254919168:0@lo:400:kworker.0 00000100:00100000:0.0:1789762904.917876:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207355030311 time 207355100705 state 0x0 ref 1 00000100:00100000:0.0:1789762904.917901:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246585088:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762904.917938:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762904.917952:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762904.917955:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762904.917959:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762904.917970:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.921554:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.921565:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.921572:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.921577:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c2dc6000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762904.921580:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.921586:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.921599:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762904.921604:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aa568b7/0x5915dfb1c1b5a74f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762904.921649:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246585088:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3757us (196757us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762904.921657:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:3.0:1789762904.921662:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207355030311 time 207355100705 state 0x2 ref 0 00000100:00100000:3.0:1789762904.924711:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762904.924774:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585216 00000100:00100000:1.0:1789762904.924782:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585216 00000100:00100000:1.0:1789762904.924815:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207355030311 time 207355100705 state 0x0 ref 1 00000100:00100000:1.0:1789762904.924824:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207555100705 time 207355100705 state 0x1 ref 1 00010000:00010000:2.0:1789762904.954896:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762905.117927:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207555100705 time 207555164693 state 0x0 ref 1 00000100:00100000:1.0:1789762905.117965:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246585216:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762905.118004:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789762905.118008:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762905.118025:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762905.118029:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762905.118035:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.118046:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.121515:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.121524:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.121529:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.121534:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762905.121537:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.121555:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.121567:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.121572:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a756 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762905.121619:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246585216:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3678us (196909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762905.121627:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:1.0:1789762905.121633:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207555100705 time 207555164693 state 0x2 ref 0 00000100:00100000:3.0:1789762905.123700:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762905.123785:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585344 00000100:00100000:0.0:1789762905.123793:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585344 00000100:00100000:0.0:1789762905.123826:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207555100705 time 207555164693 state 0x0 ref 1 00000100:00100000:0.0:1789762905.123834:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207755164693 time 207555164693 state 0x1 ref 1 00000100:00100000:3.0:1789762905.318049:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207755164693 time 207755284111 state 0x0 ref 1 00000100:00100000:3.0:1789762905.318086:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246585344:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762905.318136:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.318154:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762905.318158:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762905.318164:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.318178:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.322204:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.322215:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.322222:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.322227:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c2dc5c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762905.322239:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.322247:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.322263:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762905.322268:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048c0e3eb/0x5915dfb1c1b5a75d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762905.322321:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246585344:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4254us (198625us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762905.322329:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 184 00000100:00100000:3.0:1789762905.322336:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207755164693 time 207755284111 state 0x2 ref 0 00000100:00100000:3.0:1789762905.324578:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762905.324664:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585472 00000100:00100000:0.0:1789762905.324680:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585472 00000100:00100000:0.0:1789762905.324727:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207755164693 time 207755284111 state 0x0 ref 1 00000100:00100000:0.0:1789762905.324738:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207955284111 time 207755284111 state 0x1 ref 1 00000100:00100000:0.0:1789762905.475999:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762905.476039:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762905.476070:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585600 00000100:00100000:0.0:1789762905.476075:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762905.476082:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585600 00000100:00100000:3.0:1789762905.476159:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585728 00000100:00100000:1.0:1789762905.476164:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585856 00000100:00100000:2.0:1789762905.476167:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 255 00000100:00100000:3.0:1789762905.476167:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585728 00000100:00100000:1.0:1789762905.476186:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585856 00000100:00100000:2.0:1789762905.476189:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246585600:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:0.0:1789762905.476210:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762905.476239:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:3.0:1789762905.476251:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246585728:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762905.476270:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e06e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246585600:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762905.476287:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 255 00000100:00100000:1.0:1789762905.476309:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:3.0:1789762905.476310:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246585728:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762905.476331:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:1.0:1789762905.476341:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246585856:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762905.476419:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246585856:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 92us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762905.476430:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:2.0:1789762905.518133:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207955284111 time 207955373243 state 0x0 ref 1 00000100:00100000:2.0:1789762905.518153:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246585472:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762905.518184:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762905.518199:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762905.518203:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762905.518207:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762905.518218:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.521430:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.521445:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.521469:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.521475:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4de5e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762905.521479:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.521486:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.521504:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.521510:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd44a15/0x5915dfb1c1b5a764 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762905.521578:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246585472:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3431us (197000us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762905.521587:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:1.0:1789762905.521594:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207955284111 time 207955373243 state 0x2 ref 0 00000100:00100000:0.0:1789762905.523672:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762905.523713:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246585984 00000100:00100000:1.0:1789762905.523722:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246585984 00000100:00100000:1.0:1789762905.523777:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 207955284111 time 207955373243 state 0x0 ref 1 00000100:00100000:1.0:1789762905.523788:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208155373243 time 207955373243 state 0x1 ref 1 00000100:00100000:0.0:1789762905.718271:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208155373243 time 208155503006 state 0x0 ref 1 00000100:00100000:0.0:1789762905.718301:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246585984:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762905.718337:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762905.718352:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762905.718355:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762905.718360:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762905.718374:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.722578:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.722589:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.722595:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.722601:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c334a800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762905.722604:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.722611:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.722624:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.722628:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cdc54e/0x5915dfb1c1b5a76b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762905.722688:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246585984:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4399us (199015us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762905.722698:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 186 00000100:00100000:1.0:1789762905.722706:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208155373243 time 208155503006 state 0x2 ref 0 00000100:00100000:3.0:1789762905.724827:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762905.724888:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246586112 00000100:00100000:1.0:1789762905.724897:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246586112 00000100:00100000:1.0:1789762905.724929:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208155373243 time 208155503006 state 0x0 ref 1 00000100:00100000:1.0:1789762905.724938:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208355503006 time 208155503006 state 0x1 ref 1 00000100:00100000:1.0:1789762905.918339:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208355503006 time 208355577146 state 0x0 ref 1 00000100:00100000:1.0:1789762905.918367:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246586112:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762905.918404:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.918422:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762905.918427:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762905.918434:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.918450:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.921788:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.921800:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.921807:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.921828:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762905.921832:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.921838:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.921864:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762905.921869:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a772 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762905.921920:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246586112:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3566us (197105us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762905.921927:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:1.0:1789762905.921933:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208355503006 time 208355577146 state 0x2 ref 0 00000100:00100000:2.0:1789762905.923907:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762905.923943:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246586240 00000100:00100000:1.0:1789762905.923953:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246586240 00000100:00100000:1.0:1789762905.923991:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208355503006 time 208355577146 state 0x0 ref 1 00000100:00100000:1.0:1789762905.924003:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208555577146 time 208355577146 state 0x1 ref 1 00010000:00010000:2.0:1789762905.978952:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762906.118483:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208555577146 time 208555721706 state 0x0 ref 1 00000100:00100000:2.0:1789762906.118511:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246586240:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762906.118548:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.118574:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762906.118578:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762906.118582:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.118594:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.122250:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.122260:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.122266:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.122273:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c2dc6600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762906.122276:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.122283:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.122296:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.122312:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de9c86f3/0x5915dfb1c1b5a779 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762906.122360:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246586240:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3861us (198453us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762906.122367:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:2.0:1789762906.122372:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208555577146 time 208555721706 state 0x2 ref 0 00000100:00100000:2.0:1789762906.124364:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762906.124429:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246586368 00000100:00100000:1.0:1789762906.124447:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246586368 00000100:00100000:1.0:1789762906.124520:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208555577146 time 208555721706 state 0x0 ref 1 00000100:00100000:1.0:1789762906.124551:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208755721706 time 208555721706 state 0x1 ref 1 00000100:00100000:0.0:1789762906.318644:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208755721706 time 208755881820 state 0x0 ref 1 00000100:00100000:0.0:1789762906.318674:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246586368:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762906.318725:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.318740:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762906.318743:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762906.318794:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.318808:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.322349:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.322360:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.322367:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.322373:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4d30200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762906.322376:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.322382:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.322404:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762906.322410:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000534368d6/0x5915dfb1c1b5a780 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762906.322459:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246586368:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3798us (198095us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762906.322468:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:0.0:1789762906.322474:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208755721706 time 208755881820 state 0x2 ref 0 00000100:00100000:3.0:1789762906.324574:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762906.324649:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246586496 00000100:00100000:1.0:1789762906.324661:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246586496 00000100:00100000:1.0:1789762906.324712:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208755721706 time 208755881820 state 0x0 ref 1 00000100:00100000:1.0:1789762906.324724:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208955881820 time 208755881820 state 0x1 ref 1 00000100:00100000:2.0:1789762906.518810:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208955881820 time 208956046905 state 0x0 ref 1 00000100:00100000:2.0:1789762906.518841:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246586496:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762906.518893:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.518908:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762906.518911:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762906.518918:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.518933:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.522087:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.522108:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.522116:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.522121:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3183600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762906.522124:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.522131:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.522143:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762906.522148:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a787 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762906.522196:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246586496:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3370us (197628us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762906.522203:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:2.0:1789762906.522208:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208955881820 time 208956046905 state 0x2 ref 0 00000100:00100000:2.0:1789762906.524426:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762906.524489:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246586624 00000100:00100000:1.0:1789762906.524498:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246586624 00000100:00100000:1.0:1789762906.524531:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 208955881820 time 208956046905 state 0x0 ref 1 00000100:00100000:1.0:1789762906.524539:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209156046905 time 208956046905 state 0x1 ref 1 00000100:00100000:3.0:1789762906.718969:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209156046905 time 209156202820 state 0x0 ref 1 00000100:00100000:3.0:1789762906.719009:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246586624:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762906.719067:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.719091:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762906.719097:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762906.719105:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.719125:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.722667:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.722676:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.722682:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.722687:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c334a600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762906.722691:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.722718:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.722734:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762906.722739:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a25c4b/0x5915dfb1c1b5a78e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762906.722835:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246586624:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3847us (198412us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762906.722843:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:3.0:1789762906.722861:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209156046905 time 209156202820 state 0x2 ref 0 00000100:00100000:2.0:1789762906.725221:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762906.725276:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246586752 00000100:00100000:0.0:1789762906.725287:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246586752 00000100:00100000:0.0:1789762906.725326:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209156046905 time 209156202820 state 0x0 ref 1 00000100:00100000:0.0:1789762906.725344:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209356202820 time 209156202820 state 0x1 ref 1 00000100:00100000:1.0:1789762906.919144:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209356202820 time 209356375301 state 0x0 ref 1 00000100:00100000:1.0:1789762906.919191:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246586752:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762906.919250:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.919273:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762906.919279:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762906.919287:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.919304:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.923256:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.923277:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.923285:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.923291:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762906.923295:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.923302:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.923318:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762906.923324:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a795 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762906.923388:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246586752:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4222us (198168us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762906.923396:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:1.0:1789762906.923402:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209356202820 time 209356375301 state 0x2 ref 0 00000100:00100000:0.0:1789762906.925448:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762906.925494:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246586880 00000100:00100000:2.0:1789762906.925512:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246586880 00000100:00100000:2.0:1789762906.925553:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209356202820 time 209356375301 state 0x0 ref 1 00000100:00100000:2.0:1789762906.925563:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209556375301 time 209356375301 state 0x1 ref 1 00000100:00100000:3.0:1789762906.938946:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c553ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254919680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762906.939029:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762906.939075:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919680 00000100:00100000:0.0:1789762906.939086:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919680 00000100:00080000:1.0:1789762906.939129:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762906.939178:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789762906.939192:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254919680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762906.939227:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:0.0:1789762906.939285:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254919680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762906.939296:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789762906.939330:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c553ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254919680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762907.002976:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762907.119259:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209556375301 time 209556493541 state 0x0 ref 1 00000100:00100000:0.0:1789762907.119316:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246586880:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:1.0:1789762907.119341:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762907.119375:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762907.119399:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762907.119405:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762907.119413:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762907.119431:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.123257:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.123268:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.123276:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.123282:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762907.123285:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.123292:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.123309:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.123314:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5a79c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762907.123377:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246586880:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4098us (197930us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762907.123389:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:1.0:1789762907.123396:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209556375301 time 209556493541 state 0x2 ref 0 00000100:00100000:0.0:1789762907.125326:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762907.125373:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587008 00000100:00100000:3.0:1789762907.125384:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587008 00000100:00100000:3.0:1789762907.125425:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209556375301 time 209556493541 state 0x0 ref 1 00000100:00100000:3.0:1789762907.125436:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209756493541 time 209556493541 state 0x1 ref 1 00000100:00100000:2.0:1789762907.319432:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209756493541 time 209756666290 state 0x0 ref 1 00000100:00100000:2.0:1789762907.319471:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587008:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762907.319524:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762907.319542:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762907.319547:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762907.319553:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762907.319566:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.323490:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.323501:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.323509:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.323515:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762907.323519:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.323526:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.323542:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.323547:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5a7a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762907.323604:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587008:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4153us (198277us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762907.323615:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:1.0:1789762907.323623:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209756493541 time 209756666290 state 0x2 ref 0 00000100:00100000:0.0:1789762907.325595:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762907.325641:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587136 00000100:00100000:1.0:1789762907.325652:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587136 00000100:00100000:1.0:1789762907.325689:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209756493541 time 209756666290 state 0x0 ref 1 00000100:00100000:1.0:1789762907.325700:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209956666290 time 209756666290 state 0x1 ref 1 00000100:00100000:1.0:1789762907.519558:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209956666290 time 209956791248 state 0x0 ref 1 00000100:00100000:1.0:1789762907.519598:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587136:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762907.519649:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.519668:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762907.519672:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762907.519678:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.519692:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.525344:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.525360:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.525369:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.525389:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762907.525393:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.525400:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.525416:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.525422:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762907.525496:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587136:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5918us (199900us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762907.525506:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:1.0:1789762907.525514:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209956666290 time 209956791248 state 0x2 ref 0 00000100:00100000:2.0:1789762907.527674:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762907.527785:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587264 00000100:00100000:1.0:1789762907.527799:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587264 00000100:00100000:1.0:1789762907.527863:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 209956666290 time 209956791248 state 0x0 ref 1 00000100:00100000:1.0:1789762907.527879:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210156791248 time 209956791248 state 0x1 ref 1 00000100:00100000:0.0:1789762907.719653:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210156791248 time 210156891020 state 0x0 ref 1 00000100:00100000:0.0:1789762907.719683:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587264:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762907.719721:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762907.719735:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762907.719739:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762907.719743:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762907.719820:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762907.722646:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762907.722666:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762907.722673:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762907.722678:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c2d40600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762907.722681:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762907.722688:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762907.722701:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762907.722706:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d84235c/0x5915dfb1c1b5a7b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762907.722786:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587264:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3116us (195116us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762907.722796:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:3.0:1789762907.722804:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210156791248 time 210156891020 state 0x2 ref 0 00000100:00100000:2.0:1789762907.724597:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762907.724642:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587392 00000100:00100000:1.0:1789762907.724650:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587392 00000100:00100000:1.0:1789762907.724682:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210156791248 time 210156891020 state 0x0 ref 1 00000100:00100000:1.0:1789762907.724697:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210356891020 time 210156891020 state 0x1 ref 1 00000100:00100000:2.0:1789762907.919800:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210356891020 time 210357036560 state 0x0 ref 1 00000100:00100000:2.0:1789762907.919835:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587392:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762907.919889:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762907.919915:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762907.919918:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762907.919923:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762907.919935:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.923305:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.923316:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.923322:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.923327:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4f88600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762907.923331:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.923338:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.923351:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762907.923356:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001528e39a/0x5915dfb1c1b5a7b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762907.923405:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587392:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3586us (198808us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762907.923411:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:1.0:1789762907.923423:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210356891020 time 210357036560 state 0x2 ref 0 00000100:00100000:0.0:1789762907.925263:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762907.925296:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587520 00000100:00100000:1.0:1789762907.925305:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587520 00000100:00100000:1.0:1789762907.925335:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210356891020 time 210357036560 state 0x0 ref 1 00000100:00100000:1.0:1789762907.925344:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210557036560 time 210357036560 state 0x1 ref 1 00010000:00010000:1.0:1789762908.026932:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762908.119922:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210557036560 time 210557159932 state 0x0 ref 1 00000100:00100000:3.0:1789762908.119969:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587520:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762908.120005:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.120018:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762908.120021:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762908.120026:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.120037:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.123471:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.123483:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.123490:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.123496:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762908.123499:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.123505:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.123518:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.123523:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a7bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762908.123579:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587520:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3620us (198317us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762908.123587:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:1.0:1789762908.123592:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210557036560 time 210557159932 state 0x2 ref 0 00000100:00100000:0.0:1789762908.125534:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762908.125583:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587648 00000100:00100000:3.0:1789762908.125593:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587648 00000100:00100000:3.0:1789762908.125629:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210557036560 time 210557159932 state 0x0 ref 1 00000100:00100000:3.0:1789762908.125637:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210757159932 time 210557159932 state 0x1 ref 1 00000100:00100000:3.0:1789762908.320003:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210757159932 time 210757241897 state 0x0 ref 1 00000100:00100000:3.0:1789762908.320032:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587648:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762908.320074:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.320092:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762908.320097:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762908.320103:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.320132:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.323732:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.323743:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.323773:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.323779:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762908.323782:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.323788:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.323800:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762908.323805:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762908.323876:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587648:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3857us (198342us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762908.323884:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:3.0:1789762908.323889:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210757159932 time 210757241897 state 0x2 ref 0 00000100:00100000:0.0:1789762908.325817:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762908.325870:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587776 00000100:00100000:1.0:1789762908.325878:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587776 00000100:00100000:1.0:1789762908.325912:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210757159932 time 210757241897 state 0x0 ref 1 00000100:00100000:1.0:1789762908.325921:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210957241897 time 210757241897 state 0x1 ref 1 00000100:00100000:0.0:1789762908.520091:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210957241897 time 210957329943 state 0x0 ref 1 00000100:00100000:0.0:1789762908.520116:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587776:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762908.520153:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762908.520166:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762908.520170:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762908.520175:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762908.520186:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.523283:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.523294:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.523300:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.523305:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762908.523308:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.523314:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.523344:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.523352:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5a7cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762908.523409:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246587776:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3302us (197594us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762908.523417:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:1.0:1789762908.523423:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210957241897 time 210957329943 state 0x2 ref 0 00000100:00100000:0.0:1789762908.525310:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762908.525347:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246587904 00000100:00100000:1.0:1789762908.525357:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246587904 00000100:00100000:1.0:1789762908.525395:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 210957241897 time 210957329943 state 0x0 ref 1 00000100:00100000:1.0:1789762908.525407:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211157329943 time 210957329943 state 0x1 ref 1 00000100:00100000:1.0:1789762908.720174:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211157329943 time 211157412947 state 0x0 ref 1 00000100:00100000:1.0:1789762908.720201:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587904:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762908.720238:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.720252:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762908.720255:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762908.720260:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.720286:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.723552:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.723564:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.723571:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.723576:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762908.723580:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.723586:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.723598:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762908.723602:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762908.723672:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246587904:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3481us (198360us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762908.723682:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:1.0:1789762908.723689:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211157329943 time 211157412947 state 0x2 ref 0 00000100:00100000:2.0:1789762908.725648:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762908.725688:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588032 00000100:00100000:3.0:1789762908.725696:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588032 00000100:00100000:3.0:1789762908.725729:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211157329943 time 211157412947 state 0x0 ref 1 00000100:00100000:3.0:1789762908.725737:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211357412947 time 211157412947 state 0x1 ref 1 00000100:00100000:2.0:1789762908.920318:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211357412947 time 211357556435 state 0x0 ref 1 00000100:00100000:2.0:1789762908.920348:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246588032:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762908.920387:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.920402:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762908.920406:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762908.920411:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.920421:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.923782:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.923809:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.923817:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.923822:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3183600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762908.923826:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.923848:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.923874:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762908.923880:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f85043a/0x5915dfb1c1b5a7db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762908.923938:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246588032:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3604us (198290us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762908.923945:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:2.0:1789762908.923951:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211357412947 time 211357556435 state 0x2 ref 0 00000100:00100000:2.0:1789762908.925931:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762908.925992:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588160 00000100:00100000:1.0:1789762908.926000:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588160 00000100:00100000:1.0:1789762908.926032:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211357412947 time 211357556435 state 0x0 ref 1 00000100:00100000:1.0:1789762908.926041:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211557556435 time 211357556435 state 0x1 ref 1 00010000:00010000:2.0:1789762909.050904:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762909.120403:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211557556435 time 211557642268 state 0x0 ref 1 00000100:00100000:3.0:1789762909.120446:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246588160:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:1.0:1789762909.120462:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762909.120499:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.120514:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762909.120518:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762909.120523:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.120534:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.123923:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.123946:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.123953:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.123958:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762909.123961:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.123967:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.123978:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.123983:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762909.124028:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246588160:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3610us (198097us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762909.124035:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:3.0:1789762909.124040:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211557556435 time 211557642268 state 0x2 ref 0 00000100:00100000:0.0:1789762909.125881:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762909.125926:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588288 00000100:00100000:1.0:1789762909.125933:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588288 00000100:00100000:1.0:1789762909.125964:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211557556435 time 211557642268 state 0x0 ref 1 00000100:00100000:1.0:1789762909.125973:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211757642268 time 211557642268 state 0x1 ref 1 00000100:00100000:1.0:1789762909.320479:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211757642268 time 211757716702 state 0x0 ref 1 00000100:00100000:1.0:1789762909.320506:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246588288:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762909.320549:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.320567:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762909.320570:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762909.320575:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.320600:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.323910:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.323921:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.323927:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.323933:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762909.323936:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.323941:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.323954:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.323959:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762909.324020:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246588288:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3527us (198140us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762909.324027:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:1.0:1789762909.324033:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211757642268 time 211757716702 state 0x2 ref 0 00000100:00100000:0.0:1789762909.325871:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762909.325920:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588416 00000100:00100000:2.0:1789762909.325929:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588416 00000100:00100000:2.0:1789762909.325961:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211757642268 time 211757716702 state 0x0 ref 1 00000100:00100000:2.0:1789762909.325970:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211957716702 time 211757716702 state 0x1 ref 1 00000100:00100000:3.0:1789762909.520620:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211957716702 time 211957856390 state 0x0 ref 1 00000100:00100000:3.0:1789762909.520664:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246588416:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762909.520700:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.520714:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762909.520718:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762909.520722:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.520733:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.523934:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.523944:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.523951:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.523956:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762909.523959:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.523966:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.523985:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.523991:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762909.524037:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246588416:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3383us (198167us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762909.524043:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:3.0:1789762909.524048:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211957716702 time 211957856390 state 0x2 ref 0 00000100:00100000:0.0:1789762909.525888:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762909.525923:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588544 00000100:00100000:3.0:1789762909.525931:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588544 00000100:00100000:3.0:1789762909.525961:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 211957716702 time 211957856390 state 0x0 ref 1 00000100:00100000:3.0:1789762909.525970:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212157856390 time 211957856390 state 0x1 ref 1 00000100:00100000:3.0:1789762909.720716:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212157856390 time 212157954792 state 0x0 ref 1 00000100:00100000:3.0:1789762909.720744:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246588544:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762909.720816:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.720848:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762909.720854:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762909.720862:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.720904:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.724473:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.724484:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.724490:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.724495:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762909.724498:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.724515:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.724527:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762909.724532:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a7f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762909.724597:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246588544:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3865us (198708us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762909.724605:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:3.0:1789762909.724610:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212157856390 time 212157954792 state 0x2 ref 0 00000100:00100000:3.0:1789762909.726609:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762909.726683:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588672 00000100:00100000:1.0:1789762909.726692:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588672 00000100:00100000:1.0:1789762909.726725:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212157856390 time 212157954792 state 0x0 ref 1 00000100:00100000:1.0:1789762909.726734:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212357954792 time 212157954792 state 0x1 ref 1 00000100:00100000:1.0:1789762909.920818:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212357954792 time 212358052068 state 0x0 ref 1 00000100:00100000:1.0:1789762909.920865:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246588672:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762909.920920:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.920940:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762909.920944:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762909.920949:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.920960:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.924695:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.924717:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.924728:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.924733:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762909.924737:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.924744:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.924773:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762909.924779:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a7fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762909.924838:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246588672:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3991us (198229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762909.924846:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:1.0:1789762909.924851:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212357954792 time 212358052068 state 0x2 ref 0 00000100:00100000:3.0:1789762909.926687:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762909.926723:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588800 00000100:00100000:1.0:1789762909.926737:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588800 00000100:00100000:1.0:1789762909.926783:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212357954792 time 212358052068 state 0x0 ref 1 00000100:00100000:1.0:1789762909.926792:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212558052068 time 212358052068 state 0x1 ref 1 00000100:00100000:2.0:1789762910.010950:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254919808:0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.010963:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254919936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762910.010981:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254920064:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.011007:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254920192:0@lo:400:kworker.0 00000100:00100000:2.0:1789762910.011074:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762910.011076:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762910.011092:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762910.011109:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919808 00000100:00100000:3.0:1789762910.011116:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919808 00000100:00100000:0.0:1789762910.011151:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254920576:0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.011153:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254920448:0@lo:400:kworker.0 00000100:00100000:2.0:1789762910.011154:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254920320:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.011167:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789762910.011177:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254919808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762910.011184:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762910.011202:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762910.011213:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762910.011239:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254919936 00000100:00100000:0.0:1789762910.011244:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254919936 00000100:00100000:2.0:1789762910.011246:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254919808:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.011246:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254919808:12345-0@lo:400:kworker.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762910.011263:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1789762910.011273:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762910.011289:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920576 00000100:00100000:2.0:1789762910.011294:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920576 00000100:00100000:0.0:1789762910.011301:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789762910.011314:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920320 00000100:00100000:0.0:1789762910.011315:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254919936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762910.011315:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920064 00000100:00100000:1.0:1789762910.011321:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920320 00000100:00100000:3.0:1789762910.011323:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920064 00000100:00100000:2.0:1789762910.011337:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00002000:00000024:0.0:1789762910.011347:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762910.011349:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254920576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.011366:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920448 00000100:00100000:1.0:1789762910.011370:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789762910.011371:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920448 00000100:00100000:1.0:1789762910.011384:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254920320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762910.011408:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254919936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762910.011409:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789762910.011415:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254920576:12345-0@lo:400:kworker.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762910.011424:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789762910.011425:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254920064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.011435:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254920320:12345-0@lo:400:kworker.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762910.011435:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789762910.011452:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789762910.011488:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762910.011493:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254920576:0@lo:400:kworker.0 00000100:00080000:1.0:1789762910.011493:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762910.011500:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254920064:12345-0@lo:400:kworker.0 Request processed in 77us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762910.011510:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254920320:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.011514:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789762910.011530:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254920064:0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.011536:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254919936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762910.011552:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789762910.011566:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254920448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762910.011603:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762910.011607:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254920448:12345-0@lo:400:kworker.0 Request processed in 40us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762910.011617:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789762910.011624:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254920448:0@lo:400:kworker.0 00000100:00100000:3.0:1789762910.011641:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920192 00000100:00100000:3.0:1789762910.011647:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920192 00000100:00100000:3.0:1789762910.011693:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789762910.011699:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254920192:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762910.011702:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762910.011738:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254920192:12345-0@lo:400:kworker.0 Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762910.011744:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789762910.011781:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254920192:0@lo:400:kworker.0 00010000:00010000:2.0:1789762910.074958:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762910.120905:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212558052068 time 212558142975 state 0x0 ref 1 00000100:00100000:1.0:1789762910.120936:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246588800:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762910.120981:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.121014:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762910.121019:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762910.121024:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.121036:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.124304:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.124315:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.124322:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.124327:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762910.124330:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.124336:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.124348:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.124364:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5a805 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762910.124421:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246588800:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3499us (197733us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762910.124431:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:1.0:1789762910.124437:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212558052068 time 212558142975 state 0x2 ref 0 00000100:00100000:3.0:1789762910.126517:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762910.126560:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246588928 00000100:00100000:1.0:1789762910.126569:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246588928 00000100:00100000:1.0:1789762910.126606:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212558052068 time 212558142975 state 0x0 ref 1 00000100:00100000:1.0:1789762910.126616:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212758142975 time 212558142975 state 0x1 ref 1 00000100:00100000:2.0:1789762910.321042:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212758142975 time 212758279897 state 0x0 ref 1 00000100:00100000:2.0:1789762910.321071:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246588928:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762910.321108:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.321147:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762910.321151:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762910.321156:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.321167:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.324617:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.324633:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.324644:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.324652:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c2e7c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762910.324657:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.324683:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.324699:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762910.324705:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd56d/0x5915dfb1c1b5a80c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762910.324837:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246588928:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3764us (198305us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762910.324846:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:1.0:1789762910.324852:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212758142975 time 212758279897 state 0x2 ref 0 00000100:00100000:3.0:1789762910.326697:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762910.326780:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589056 00000100:00100000:1.0:1789762910.326790:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589056 00000100:00100000:1.0:1789762910.326844:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212758142975 time 212758279897 state 0x0 ref 1 00000100:00100000:1.0:1789762910.326856:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212958279897 time 212758279897 state 0x1 ref 1 00000100:00100000:3.0:1789762910.521186:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212958279897 time 212958422818 state 0x0 ref 1 00000100:00100000:3.0:1789762910.521235:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246589056:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762910.521272:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.521297:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762910.521301:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762910.521306:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.521317:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.524624:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.524649:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.524660:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.524670:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762910.524674:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.524682:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.524695:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.524700:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a813 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762910.524747:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246589056:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3540us (198051us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762910.524812:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:3.0:1789762910.524842:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212958279897 time 212958422818 state 0x2 ref 0 00000100:00100000:3.0:1789762910.527103:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762910.527154:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589184 00000100:00100000:1.0:1789762910.527162:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589184 00000100:00100000:1.0:1789762910.527205:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 212958279897 time 212958422818 state 0x0 ref 1 00000100:00100000:1.0:1789762910.527214:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213158422818 time 212958422818 state 0x1 ref 1 00000100:00100000:0.0:1789762910.595848:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762910.595901:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762910.595910:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589440 00000100:00100000:2.0:1789762910.595920:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589440 00000100:00100000:0.0:1789762910.595940:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762910.595962:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589312 00000100:00100000:0.0:1789762910.595970:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589696 00000100:00100000:0.0:1789762910.595975:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589696 00000100:00080000:3.0:1789762910.595978:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762910.595982:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589312 00000100:00100000:2.0:1789762910.595993:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:2.0:1789762910.596006:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246589440:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:3.0:1789762910.596020:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762910.596035:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 257 00000100:00100000:0.0:1789762910.596044:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:1.0:1789762910.596049:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246589312:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762910.596059:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246589696:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762910.596072:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246589440:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762910.596079:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:1.0:1789762910.596087:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246589312:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762910.596095:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 257 00000100:00100000:0.0:1789762910.596100:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246589696:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762910.596108:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:2.0:1789762910.596131:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762910.596187:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589568 00000100:00100000:3.0:1789762910.596193:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589568 00000100:00100000:3.0:1789762910.596241:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:3.0:1789762910.596250:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2355:x1876702246589568:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762910.596342:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2355:x1876702246589568:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762910.596350:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:2.0:1789762910.721312:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213158422818 time 213158550777 state 0x0 ref 1 00000100:00100000:2.0:1789762910.721341:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246589184:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762910.721383:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.721401:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762910.721416:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762910.721424:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.721457:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.724697:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.724713:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.724722:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.724730:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762910.724735:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.724744:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.724799:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762910.724807:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5a81a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762910.724910:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246589184:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3581us (197807us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762910.724919:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:2.0:1789762910.724925:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213158422818 time 213158550777 state 0x2 ref 0 00000100:00100000:3.0:1789762910.727001:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762910.727062:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589824 00000100:00100000:1.0:1789762910.727070:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589824 00000100:00100000:1.0:1789762910.727101:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213158422818 time 213158550777 state 0x0 ref 1 00000100:00100000:1.0:1789762910.727109:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213358550777 time 213158550777 state 0x1 ref 1 00000100:00100000:3.0:1789762910.921458:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213358550777 time 213358695945 state 0x0 ref 1 00000100:00100000:3.0:1789762910.921486:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246589824:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762910.921523:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.921537:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762910.921548:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762910.921554:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.921565:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.924494:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.924511:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.924518:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.924523:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762910.924526:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.924532:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.924553:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762910.924559:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a821 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762910.924612:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246589824:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3137us (197609us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762910.924623:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:3.0:1789762910.924630:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213358550777 time 213358695945 state 0x2 ref 0 00000100:00100000:3.0:1789762910.926499:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762910.926549:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246589952 00000100:00100000:0.0:1789762910.926558:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246589952 00000100:00100000:0.0:1789762910.926590:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213358550777 time 213358695945 state 0x0 ref 1 00000100:00100000:0.0:1789762910.926598:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213558695945 time 213358695945 state 0x1 ref 1 00010000:00010000:2.0:1789762911.098909:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762911.121542:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213558695945 time 213558783118 state 0x0 ref 1 00000100:00100000:3.0:1789762911.121585:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246589952:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:0.0:1789762911.121604:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762911.121622:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.121636:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762911.121640:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762911.121645:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.121655:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.124626:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.124641:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.124651:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.124657:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762911.124661:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.124667:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.124699:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.124705:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a828 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762911.124789:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246589952:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3233us (198290us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762911.124797:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:1.0:1789762911.124803:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213558695945 time 213558783118 state 0x2 ref 0 00000100:00100000:0.0:1789762911.126276:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762911.126316:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246590208 00000100:00100000:3.0:1789762911.126324:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246590208 00000100:00100000:3.0:1789762911.126358:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:3.0:1789762911.126364:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:11135:x1876702246590208:12345-192.168.203.36@tcp:35:dd.500 00000100:00100000:3.0:1789762911.126574:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:11135:x1876702246590208:12345-192.168.203.36@tcp:35:dd.500 Request processed in 210us (299us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789762911.126580:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:0.0:1789762911.149451:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762911.149547:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246590336 00000100:00100000:2.0:1789762911.149557:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246590336 00000100:00100000:2.0:1789762911.149612:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:2.0:1789762911.149621:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5431:x1876702246590336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762911.149635:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762911.149670:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a56c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446e2 expref: 6 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.149692:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762911.149737:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:5431:x1876702246590336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 117us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762911.149742:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:0.0:1789762911.159586:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762911.159636:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246590464 00000100:00100000:1.0:1789762911.159644:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246590464 00000100:00100000:1.0:1789762911.159693:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 145 00000100:00100000:1.0:1789762911.159705:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:10117:x1876702246590464:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1789762911.159727:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762911.159918:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a82f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446e9 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.160034:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.160048:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.160059:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762911.160131:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00000004:00200000:1.0:1789762911.160134:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762911.160156:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.160198:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a82f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446e9 expref: 13 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.160222:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446e9 expref: 12 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.160232:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:1.0:1789762911.160235:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762911.160239:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7800, rc 0) 00000100:00100000:1.0:1789762911.160318:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:10117:x1876702246590464:12345-192.168.203.36@tcp:101:bash.0 Request processed in 616us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762911.160328:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 145 00000100:00100000:0.0:1789762911.163883:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762911.163937:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246590720 00000100:00100000:3.0:1789762911.163943:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246590720 00000100:00100000:3.0:1789762911.163979:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:3.0:1789762911.163985:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:11150:x1876702246590720:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762911.163994:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762911.164026:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a83d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446f0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762911.164108:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00010000:00010000:3.0:1789762911.164182:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a83d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446f0 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.164193:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:3.0:1789762911.164195:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762911.164198:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a83d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446f0 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.164207:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cefa00, rc 0) 00000100:00100000:3.0:1789762911.164249:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:11150:x1876702246590720:12345-192.168.203.36@tcp:101:rm.0 Request processed in 264us (368us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789762911.164254:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:0.0:1789762911.165704:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762911.165774:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246590848 00000100:00100000:1.0:1789762911.165784:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246590848 00000100:00100000:1.0:1789762911.165841:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:1.0:1789762911.165850:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:11150:x1876702246590848:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:1.0:1789762911.167969:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:11150:x1876702246590848:12345-192.168.203.36@tcp:37:rm.0 Request processed in 2117us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762911.167977:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:0.0:1789762911.169155:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762911.169197:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246591104 00000100:00100000:3.0:1789762911.169203:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246591104 00000100:00100000:3.0:1789762911.169229:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:3.0:1789762911.169234:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:11150:x1876702246591104:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762911.169343:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:11150:x1876702246591104:12345-192.168.203.36@tcp:35:rm.0 Request processed in 109us (190us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789762911.169349:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:0.0:1789762911.170280:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762911.170325:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246591360 00000100:00100000:2.0:1789762911.170330:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246591360 00000100:00100000:2.0:1789762911.170360:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:2.0:1789762911.170368:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:11150:x1876702246591360:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:2.0:1789762911.170378:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762911.170387:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a84b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446f7 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.170444:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a852 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.170455:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a852 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.170464:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a852 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762911.170470:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00010000:00010000:2.0:1789762911.170510:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a84b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446f7 expref: 17 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.170521:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446f7 expref: 16 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.170527:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:2.0:1789762911.170529:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762911.170531:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3055c00, rc 0) 00000100:00100000:2.0:1789762911.170558:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:11150:x1876702246591360:12345-192.168.203.36@tcp:101:rm.0 Request processed in 192us (279us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789762911.170563:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:0.0:1789762911.171492:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762911.171528:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246591488 00000100:00100000:3.0:1789762911.171533:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246591488 00000100:00100000:3.0:1789762911.171561:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 148 00000100:00100000:3.0:1789762911.171566:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:11150:x1876702246591488:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:3.0:1789762911.171611:0:12191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7742480384 avail 7279435776 00000100:00100000:3.0:1789762911.171652:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:11150:x1876702246591488:12345-192.168.203.36@tcp:41:rm.0 Request processed in 85us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762911.171658:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 148 00000100:00100000:0.0:1789762911.172566:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762911.172599:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246591744 00000100:00100000:2.0:1789762911.172603:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246591744 00000100:00100000:2.0:1789762911.172631:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 149 00000100:00100000:2.0:1789762911.172637:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:11150:x1876702246591744:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762911.172656:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789762911.172689:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a55e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446db expref: 16 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172701:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de4600/0x5915dfb1c1b5a25c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446cd expref: 15 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172710:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5a00/0x5915dfb1c1b5a201 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446b1 expref: 14 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172717:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33e2f49700) 00010000:00010000:2.0:1789762911.172725:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7800/0x5915dfb1c1b5a836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446e9 expref: 13 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172731:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:2.0:1789762911.172733:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762911.172742:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172749:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172780:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172811:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172828:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172834:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172918:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172924:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.172929:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762911.173086:0:5925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00000004:00080000:2.0:1789762911.173094:0:5925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213610341832ns, next at 214610340448ns, rc = 0 00010000:00010000:2.0:1789762911.173116:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173123:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173129:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173134:0:5925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173139:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173142:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173156:0:5925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762911.173165:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173174:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173179:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173184:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762911.173188:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.173189:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762911.173201:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173201:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173209:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33ed2a9b00) 00010000:00010000:2.0:1789762911.173212:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762911.173215:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173219:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a86e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.173236:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762911.173242:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173243:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.173258:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173259:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173277:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173281:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762911.173284:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff9b33ed2a9b00) 00010000:00010000:1.0:1789762911.173293:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789762911.173293:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.173300:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173302:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.173321:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a875 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173322:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:2.0:1789762911.173330:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762911.173335:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.173343:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a860 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.173344:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762911.173347:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762911.173350:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1789762911.173362:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c930298 reply state 00000000c09823bd transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762911.173372:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762911.173410:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:11150:x1876702246591744:12345-192.168.203.36@tcp:36:rm.0 Request processed in 773us (844us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789762911.173416:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 149 00010000:00010000:3.0:1789762911.173972:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.173981:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.173985:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.173989:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762911.173991:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.173995:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.174003:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff9b33ed2a9d00) 00010000:00010000:3.0:1789762911.174005:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762911.174007:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762911.174010:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a867 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762911.174376:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762911.174415:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246592000 00000100:00100000:1.0:1789762911.174421:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246592000 00000100:00100000:1.0:1789762911.174458:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:1.0:1789762911.174466:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:11150:x1876702246592000:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:1.0:1789762911.174676:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:11150:x1876702246592000:12345-192.168.203.36@tcp:35:rm.0 Request processed in 208us (299us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789762911.174685:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:0.0:1789762911.175330:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762911.175371:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246592256 00000100:00100000:1.0:1789762911.175378:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246592256 00000100:00100000:1.0:1789762911.175412:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 150 00000100:00100000:1.0:1789762911.175419:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:11150:x1876702246592256:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:1.0:1789762911.175455:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789762911.175470:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446f7 expref: 14 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175487:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4de5800/0x5915dfb1c1b5a1d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446a3 expref: 13 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175497:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e2f49c00) 00010000:00010000:1.0:1789762911.175508:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a16e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894468e expref: 12 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175515:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:1.0:1789762911.175520:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762911.175532:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175539:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175546:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175581:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175592:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175600:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175694:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175702:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175706:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762911.175896:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 4096 00010000:00010000:1.0:1789762911.175906:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175911:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175916:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175920:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762911.175923:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175928:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175934:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9b33e0c25300) 00010000:00010000:1.0:1789762911.175935:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789762911.175938:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175951:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5a88a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175965:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175969:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175973:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175977:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762911.175979:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175982:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175987:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e0c25f00) 00010000:00010000:1.0:1789762911.175988:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762911.175990:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762911.175993:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5a87c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762911.176000:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000248149a9 reply state 000000009ebbd540 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762911.176005:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762911.176047:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:11150:x1876702246592256:12345-192.168.203.36@tcp:36:rm.0 Request processed in 628us (718us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1789762911.176053:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 150 00010000:00010000:2.0:1789762911.176564:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.176572:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.176576:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.176580:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762911.176582:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.176594:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.176602:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33e0c25200) 00010000:00010000:2.0:1789762911.176603:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762911.176606:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762911.176610:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6c00/0x5915dfb1c1b5a883 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762912.046915:0:13053:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 214484161654ns, next at 214610340448ns, rc = 0 00080000:00080000:3.0:1789762912.046930:0:13053:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789762912.047982:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000001:00080000:1.0:1789762912.048004:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967404 is committed 00000004:00080000:1.0:1789762912.048011:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:1.0:1789762912.048118:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c243df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254920704:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762912.048195:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762912.048245:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920704 00000100:00100000:2.0:1789762912.048256:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920704 00000100:00080000:0.0:1789762912.048303:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762912.048332:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789762912.048347:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254920704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762912.048376:0:12136:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:7 count 1 00002000:00010000:2.0:1789762912.048408:0:12136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 104857600, mtime: 0x6aad9d4b, atime: 0x6aad9d37, ctime: 0x6aad9d4b, blocks: 0x32000 00010000:00010000:2.0:1789762912.048417:0:12136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762912.048434:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=214s v=(0 0) 00010000:00010000:2.0:1789762912.048439:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762912.048445:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762912.048463:0:12136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762912.048489:0:12136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762912.048499:0:12136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762912.048524:0:12136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762912.048546:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762912.048555:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762912.048566:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762912.048571:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762912.048582:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762912.048600:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762912.048608:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5a891 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762912.048631:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762912.048634:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762912.048636:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762912.048713:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254920704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 369us (514us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1789762912.048726:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000004:00080000:1.0:1789762912.048801:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c243df80/2, rc 0, transno 4294967529 00000100:00100000:1.0:1789762912.048836:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c243df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254920704:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789762912.048968:0:13053:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 214486215690ns, next at 177608179767ns, rc = 0 00080000:00080000:3.0:1789762912.048978:0:13053:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789762912.049491:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1789762912.058935:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254920832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762912.058998:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762912.059063:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920832 00000100:00100000:1.0:1789762912.059075:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920832 00000100:00100000:1.0:1789762912.059159:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789762912.059178:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254920832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762912.059225:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:1.0:1789762912.059317:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254920832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762912.059329:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789762912.059357:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254920832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762912.123890:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762913.146961:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762914.170930:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762915.130892:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789762915.130903:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789762915.130914:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254920960:0@lo:400:kworker.0 00000100:00100000:0.0:1789762915.130918:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254921088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762915.130930:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254921472:0@lo:400:kworker.0 00000100:00100000:3.0:1789762915.130940:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254921216:0@lo:400:kworker.0 00000100:00100000:2.0:1789762915.130996:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762915.131014:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762915.131062:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762915.131064:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762915.131074:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254921600:0@lo:400:kworker.0 00000100:00100000:2.0:1789762915.131079:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254920960 00000100:00100000:2.0:1789762915.131086:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254920960 00000100:00100000:1.0:1789762915.131121:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254921344:0@lo:400:kworker.0 00000100:00100000:3.0:1789762915.131126:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254921728:0@lo:400:kworker.0 00000100:00100000:2.0:1789762915.131140:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789762915.131141:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762915.131160:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254920960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762915.131184:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762915.131191:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762915.131214:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921088 00000100:00100000:0.0:1789762915.131220:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921088 00000100:00100000:2.0:1789762915.131248:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254920960:12345-0@lo:400:kworker.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762915.131258:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1789762915.131270:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762915.131282:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921216 00000100:00100000:0.0:1789762915.131287:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789762915.131290:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921216 00000100:00100000:0.0:1789762915.131303:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254921088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762915.131330:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921472 00002000:00000024:0.0:1789762915.131331:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762915.131331:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921728 00000100:00100000:2.0:1789762915.131339:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921728 00000100:00100000:3.0:1789762915.131344:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921600 00000100:00100000:1.0:1789762915.131359:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921472 00000100:00100000:3.0:1789762915.131360:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921600 00000100:00100000:2.0:1789762915.131387:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789762915.131399:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254921088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762915.131402:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254921728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762915.131409:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921344 00000100:00100000:0.0:1789762915.131411:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789762915.131414:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921344 00000100:00100000:1.0:1789762915.131454:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789762915.131463:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789762915.131469:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254921472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762915.131478:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254921216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762915.131479:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254921728:12345-0@lo:400:kworker.0 Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762915.131481:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254921088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762915.131498:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789762915.131543:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254921216:12345-0@lo:400:kworker.0 Request processed in 68us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762915.131562:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254921472:12345-0@lo:400:kworker.0 Request processed in 92us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762915.131562:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789762915.131584:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789762915.131585:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789762915.131608:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789762915.131614:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254921600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762915.131626:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254921344:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762915.131654:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789762915.131662:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762915.131676:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254921472:0@lo:400:kworker.0 00000100:00100000:2.0:1789762915.131684:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254921600:12345-0@lo:400:kworker.0 Request processed in 72us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762915.131692:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254921344:12345-0@lo:400:kworker.0 Request processed in 68us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762915.131709:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789762915.131713:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254920960:0@lo:400:kworker.0 00000100:00100000:0.0:1789762915.131720:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789762915.131723:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254921344:0@lo:400:kworker.0 00000100:00100000:2.0:1789762915.131804:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254921216:0@lo:400:kworker.0 00000100:00100000:2.0:1789762915.131834:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254921728:0@lo:400:kworker.0 00000100:00100000:3.0:1789762915.131848:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254921600:0@lo:400:kworker.0 00010000:00010000:3.0:1789762915.194930:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762915.716139:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762915.716177:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762915.716189:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246592512 00000100:00100000:0.0:1789762915.716214:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762915.716247:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762915.716270:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246592512 00000100:00100000:2.0:1789762915.716281:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246592640 00000100:00100000:2.0:1789762915.716289:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246592640 00000100:00080000:0.0:1789762915.716323:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762915.716331:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762915.716343:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246592768 00000100:00100000:3.0:1789762915.716347:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246592768 00000100:00100000:2.0:1789762915.716351:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:2.0:1789762915.716368:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246592640:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762915.716373:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246592384 00000100:00100000:0.0:1789762915.716375:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:0.0:1789762915.716394:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246592512:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762915.716398:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246592384 00000100:00100000:3.0:1789762915.716400:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:3.0:1789762915.716419:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246592768:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762915.716448:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246592640:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762915.716455:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246592512:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 68us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762915.716462:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:0.0:1789762915.716468:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:3.0:1789762915.716468:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246592768:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762915.716498:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:1.0:1789762915.716554:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 259 00000100:00100000:1.0:1789762915.716580:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2353:x1876702246592384:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:0.0:1789762915.716609:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762915.716727:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2353:x1876702246592384:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 139us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762915.716747:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 259 00010000:00010000:2.0:1789762916.218949:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762917.179080:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254921856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762917.179189:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762917.179245:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921856 00000100:00100000:1.0:1789762917.179259:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921856 00000100:00080000:0.0:1789762917.179328:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762917.179344:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789762917.179360:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254921856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762917.179400:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762917.179466:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254921856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762917.179473:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789762917.179566:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254921856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762917.242976:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789762917.691949:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967529 is committed 00010000:00010000:1.0:1789762918.266898:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762919.290899:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762920.250907:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789762920.250911:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789762920.250934:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254922624:0@lo:400:kworker.0 00000100:00100000:3.0:1789762920.250934:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789762920.250935:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254922240:0@lo:400:kworker.0 00000100:00100000:0.0:1789762920.250950:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254922368:0@lo:400:kworker.0 00000100:00100000:3.0:1789762920.251024:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762920.251025:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762920.251060:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254921984 00000100:00100000:1.0:1789762920.251067:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254921984 00000100:00100000:0.0:1789762920.251082:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254922240 00000100:00100000:0.0:1789762920.251087:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254922240 00000100:00100000:3.0:1789762920.251105:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c243d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254922112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762920.251108:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254922752:0@lo:400:kworker.0 00000100:00100000:1.0:1789762920.251118:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789762920.251131:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254921984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762920.251137:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789762920.251141:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762920.251160:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254922240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762920.251160:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762920.251198:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ed213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254921984:12345-0@lo:400:kworker.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762920.251204:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789762920.251216:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789762920.251218:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254922752 00000100:00100000:0.0:1789762920.251228:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254922240:12345-0@lo:400:kworker.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762920.251234:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254922752 00000100:00100000:0.0:1789762920.251241:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789762920.251257:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762920.251290:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254922496:0@lo:400:kworker.0 00000100:00100000:0.0:1789762920.251291:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254922624 00000100:00100000:2.0:1789762920.251297:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789762920.251298:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254922624 00000100:00100000:3.0:1789762920.251299:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254922240:0@lo:400:kworker.0 00000100:00100000:2.0:1789762920.251315:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254922752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762920.251322:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762920.251339:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789762920.251344:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254922496 00000100:00100000:3.0:1789762920.251349:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254922496 00000100:00100000:0.0:1789762920.251351:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254922624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762920.251370:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254922752:12345-0@lo:400:kworker.0 Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762920.251378:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789762920.251382:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254922112 00000100:00100000:1.0:1789762920.251388:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254922112 00000100:00100000:0.0:1789762920.251407:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254922624:12345-0@lo:400:kworker.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762920.251407:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789762920.251418:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789762920.251422:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254922496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762920.251427:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789762920.251442:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254922112:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789762920.251443:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762920.251449:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762920.251453:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762920.251461:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254922752:0@lo:400:kworker.0 00002000:00000024:1.0:1789762920.251472:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789762920.251478:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254922496:12345-0@lo:400:kworker.0 Request processed in 59us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762920.251483:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254922624:0@lo:400:kworker.0 00000100:00100000:3.0:1789762920.251486:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789762920.251507:0:3420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967529 gen 2 00000004:00080000:0.0:1789762920.251512:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c243df80, transno 4294967529 00000100:00100000:0.0:1789762920.251524:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254922496:0@lo:400:kworker.0 00000100:00100000:2.0:1789762920.251525:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762920.251552:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254922112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762920.251562:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789762920.251588:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c243d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254922112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762920.251588:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254922368 00000100:00100000:2.0:1789762920.251594:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254922368 00000100:00080000:1.0:1789762920.251627:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762920.251632:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789762920.251640:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254922368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762920.251683:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254922368:12345-0@lo:400:kworker.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762920.251688:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789762920.251726:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254922368:0@lo:400:kworker.0 00010000:00010000:2.0:1789762920.314861:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762920.835915:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762920.835960:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762920.835982:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246592896 00000100:00100000:1.0:1789762920.835996:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246592896 00000100:00100000:0.0:1789762920.836003:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762920.836036:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593024 00000100:00100000:2.0:1789762920.836047:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593024 00000100:00100000:0.0:1789762920.836057:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762920.836057:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593152 00000100:00100000:3.0:1789762920.836065:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593152 00000100:00100000:1.0:1789762920.836078:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 261 00000100:00100000:1.0:1789762920.836098:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246592896:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762920.836115:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593280 00000100:00100000:2.0:1789762920.836120:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593280 00000100:00100000:3.0:1789762920.836122:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:3.0:1789762920.836137:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246593152:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762920.836144:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:0.0:1789762920.836167:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246593024:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762920.836191:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:1.0:1789762920.836198:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246592896:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 102us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762920.836210:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 261 00000100:00100000:2.0:1789762920.836214:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246593280:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762920.836218:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246593152:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762920.836231:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246593024:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762920.836240:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:0.0:1789762920.836246:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:2.0:1789762920.836267:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246593280:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 60us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762920.836278:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 137 00000100:00080000:0.0:1789762920.836295:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762920.836300:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:0.0:1789762921.241997:0:13509:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789762921.242004:0:13509:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:2.0:1789762921.291705:0:13532:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789762921.291712:0:13532:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1789762921.338896:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762921.643659:0:13583:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff9b33fef9fa00 key gid={500} rule@0xffff9b33f7241600 gen 0 rate 5 depth 3 token 0 deadline 213558695945 time 213558783118 state 0x6 ref 0 00000100:00100000:0.0:1789762921.643674:0:13583:0:(nrs_tbf.c:670:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff9b32c2dd0600 key gid={0} rule@0xffff9b33f7241b00 gen 0 rate 10000 depth 3 token 2 deadline 173240956010 time 173307431751 state 0x6 ref 0 00000100:00100000:3.0:1789762922.298910:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789762922.298933:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254922880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762922.298992:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762922.299051:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254922880 00000100:00100000:1.0:1789762922.299062:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254922880 00000100:00080000:0.0:1789762922.299102:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762922.299123:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789762922.299136:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254922880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789762922.299166:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762922.299218:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254922880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762922.299224:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789762922.299273:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254922880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762922.362886:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762923.386913:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762924.410915:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762925.370885:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789762925.370895:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789762925.370908:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254923008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762925.370911:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254923136:0@lo:400:kworker.0 00000100:00100000:0.0:1789762925.371002:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762925.371010:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762925.371025:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254923392:0@lo:400:kworker.0 00000100:00100000:3.0:1789762925.371045:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254923264:0@lo:400:kworker.0 00000100:00100000:0.0:1789762925.371088:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254923648:0@lo:400:kworker.0 00000100:00100000:2.0:1789762925.371093:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254923520:0@lo:400:kworker.0 00000100:00100000:1.0:1789762925.371119:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762925.371134:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254923008 00000100:00100000:3.0:1789762925.371144:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254923008 00000100:00100000:2.0:1789762925.371156:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762925.371160:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254923136 00000100:00100000:0.0:1789762925.371167:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254923136 00000100:00100000:1.0:1789762925.371221:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254923392 00000100:00100000:2.0:1789762925.371226:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254923520 00000100:00100000:1.0:1789762925.371227:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254923392 00000100:00100000:2.0:1789762925.371232:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254923520 00000100:00100000:0.0:1789762925.371255:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789762925.371274:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254923136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762925.371293:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789762925.371302:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789762925.371309:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254923008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762925.371312:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789762925.371323:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254923392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762925.371344:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254923520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762925.371350:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254923136:12345-0@lo:400:kworker.0 Request processed in 81us (348us total) trans 0 rc 0/0 00002000:00000024:3.0:1789762925.371355:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762925.371371:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789762925.371392:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254923392:12345-0@lo:400:kworker.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762925.371405:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789762925.371429:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254923520:12345-0@lo:400:kworker.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762925.371435:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254923008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (431us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762925.371446:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762925.371458:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789762925.371461:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762925.371469:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789762925.371470:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254923392:0@lo:400:kworker.0 00000100:00080000:0.0:1789762925.371472:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762925.371519:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762925.371556:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254923520:0@lo:400:kworker.0 00000100:00100000:3.0:1789762925.371579:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254923648 00000100:00100000:3.0:1789762925.371585:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254923648 00000100:00100000:1.0:1789762925.371587:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254923136:0@lo:400:kworker.0 00000100:00100000:0.0:1789762925.371629:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254923008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762925.371629:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789762925.371642:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254923648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762925.371653:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762925.371699:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254923264 00000100:00100000:1.0:1789762925.371706:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254923776:0@lo:400:kworker.0 00000100:00100000:0.0:1789762925.371707:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254923264 00000100:00100000:3.0:1789762925.371724:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254923648:12345-0@lo:400:kworker.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762925.371738:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789762925.371806:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789762925.371815:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762925.371824:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254923264:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789762925.371857:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762925.371890:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254923776 00000100:00100000:3.0:1789762925.371891:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254923264:12345-0@lo:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762925.371899:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254923776 00000100:00100000:3.0:1789762925.371906:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789762925.371907:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254923264:0@lo:400:kworker.0 00000100:00100000:3.0:1789762925.371964:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254923648:0@lo:400:kworker.0 00000100:00100000:2.0:1789762925.371991:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789762925.372000:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254923776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762925.372043:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254923776:12345-0@lo:400:kworker.0 Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762925.372048:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789762925.372102:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254923776:0@lo:400:kworker.0 00010000:00010000:3.0:1789762925.434843:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762925.955668:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762925.955719:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762925.955727:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593408 00000100:00100000:1.0:1789762925.955741:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593408 00000100:00100000:2.0:1789762925.955788:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762925.955837:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593536 00000100:00100000:3.0:1789762925.955848:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593536 00000100:00100000:2.0:1789762925.955858:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762925.955918:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593792 00000100:00100000:2.0:1789762925.955924:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593792 00000100:00100000:3.0:1789762925.955956:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:3.0:1789762925.955970:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246593536:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762925.955989:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:2.0:1789762925.956004:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246593792:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762925.956059:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246593536:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762925.956069:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:2.0:1789762925.956077:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246593792:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 73us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762925.956090:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00080000:3.0:1789762925.956111:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762925.956120:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 263 00000100:00100000:1.0:1789762925.956132:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246593408:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762925.956138:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593664 00000100:00100000:2.0:1789762925.956145:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593664 00000100:00100000:1.0:1789762925.956189:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246593408:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 60us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762925.956197:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 263 00000100:00100000:2.0:1789762925.956203:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1789762925.956218:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246593664:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:1.0:1789762925.956266:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762925.956283:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246593664:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 69us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762925.956293:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1789762926.105254:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762926.105296:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246593920 00000100:00100000:0.0:1789762926.105305:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246593920 00000100:00100000:0.0:1789762926.105353:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:0.0:1789762926.105362:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:10117:x1876702246593920:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1789762926.105379:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762926.105436:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789446fe expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762926.105494:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a89f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762926.105506:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762926.105516:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762926.105554:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762926.105558:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762926.105577:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762926.105603:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5a898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446fe expref: 7 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762926.105627:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a89f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446fe expref: 6 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762926.105658:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74100) 00010000:00010000:0.0:1789762926.105662:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762926.105665:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461800, rc 0) 00000100:00100000:0.0:1789762926.105729:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:10117:x1876702246593920:12345-192.168.203.36@tcp:101:bash.0 Request processed in 367us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762926.105744:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:1.0:1789762926.106852:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762926.106888:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246594048 00000100:00100000:3.0:1789762926.106894:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246594048 00000100:00100000:3.0:1789762926.106924:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 152 00000100:00100000:3.0:1789762926.106932:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:10117:x1876702246594048:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1789762926.106941:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762926.106950:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a8a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944705 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.106979:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.106986:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.106998:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107008:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107013:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107017:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107045:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107050:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107054:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107059:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762926.107062:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107067:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107074:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74100) 00010000:00010000:3.0:1789762926.107076:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762926.107078:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107089:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107103:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107109:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107116:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107122:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762926.107125:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107133:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107142:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff9b33fec92f00) 00010000:00010000:3.0:1789762926.107143:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762926.107146:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107150:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107170:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a8a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944705 expref: 7 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107186:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74100) 00010000:00010000:3.0:1789762926.107187:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762926.107190:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a8a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944705 expref: 7 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762926.107196:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cefa00, rc 0) 00000100:00100000:3.0:1789762926.107227:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:10117:x1876702246594048:12345-192.168.203.36@tcp:101:bash.0 Request processed in 297us (381us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762926.107232:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 152 00010000:00010000:2.0:1789762926.458852:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789762926.604573:0:13777:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 16:22:06 (1789762926) 00000100:00100000:2.0:1789762926.989198:0:13825:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762926.989206:0:13825:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f46d3000 rate 10000 gen 0 00000100:00100000:2.0:1789762926.989237:0:13825:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762926.989240:0:13825:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f46d3700 rate 10000 gen 0 00000100:00100000:2.0:1789762926.989393:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762926.989403:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:2.0:1789762926.989411:0:13825:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762926.989416:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762926.989419:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:2.0:1789762926.989422:0:13825:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f46d3100 rate 20 gen 0 00000100:00100000:2.0:1789762926.989424:0:13825:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762926.989427:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762926.989429:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:2.0:1789762926.989432:0:13825:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f46d3a00 rate 20 gen 0 00000100:00100000:2.0:1789762926.989522:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762926.989526:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:2.0:1789762926.989535:0:13825:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762926.989539:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762926.989542:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:2.0:1789762926.989545:0:13825:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33fc553900 rate 10 gen 0 00000100:00100000:2.0:1789762926.989547:0:13825:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:2.0:1789762926.989550:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:2.0:1789762926.989553:0:13825:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:2.0:1789762926.989556:0:13825:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f7546200 rate 10 gen 0 00000100:00100000:3.0:1789762927.001667:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.001733:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246594304 00000100:00100000:1.0:1789762927.001748:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246594304 00000100:00080000:3.0:1789762927.001810:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762927.001847:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 153 00000100:00100000:1.0:1789762927.001860:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12273:x1876702246594304:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:1.0:1789762927.001923:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762927.001953:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5a89f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789446fe expref: 6 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.001971:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74100) 00010000:00010000:1.0:1789762927.001981:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762927.002045:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002058:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002067:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002085:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002091:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002096:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762927.002599:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00010000:00010000:1.0:1789762927.002609:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002614:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002619:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002624:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762927.002628:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002634:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002641:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e0c25100) 00010000:00010000:1.0:1789762927.002644:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762927.002648:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.002661:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762927.002675:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae98c80b reply state 00000000d159a71d transno 4294967405 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762927.002682:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789762927.002809:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12273:x1876702246594304:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 952us (1146us total) trans 4294967405 rc 0/0 00000100:00100000:1.0:1789762927.002816:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 153 00010000:00010000:3.0:1789762927.003432:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.003442:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.003449:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.003455:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.003458:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.003464:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.003488:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33e0c25800) 00010000:00010000:3.0:1789762927.003490:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.003493:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.003498:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5a8c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.008215:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.008292:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246594432 00000100:00100000:1.0:1789762927.008299:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246594432 00000100:00100000:1.0:1789762927.008336:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 154 00000100:00100000:1.0:1789762927.008345:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12274:x1876702246594432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762927.008360:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762927.008372:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894470c expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.008421:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5a8d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.008433:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5a8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.008444:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5a8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762927.008470:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762927.008474:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762927.008496:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5a8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.008515:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a8c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894470c expref: 8 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.008526:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5a8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894470c expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.008532:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e0c25100) 00010000:00010000:1.0:1789762927.008534:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762927.008537:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da6000, rc 0) 00000100:00100000:1.0:1789762927.008573:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12274:x1876702246594432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 231us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762927.008578:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 154 00000100:00100000:0.0:1789762927.009604:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.009675:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246594688 00000100:00100000:2.0:1789762927.009684:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246594688 00000100:00100000:2.0:1789762927.009743:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:2.0:1789762927.009780:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12274:x1876702246594688:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762927.009798:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.009800:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762927.009816:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5a8d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894470c expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.009828:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33e0c25100) 00010000:00010000:2.0:1789762927.009838:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762927.009850:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a8d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944713 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.009953:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.009963:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.009978:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.009997:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010002:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010007:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010060:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010069:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010077:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.010087:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00010000:00010000:2.0:1789762927.010100:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010108:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010114:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010119:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.010121:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010134:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010143:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9800) 00010000:00010000:2.0:1789762927.010145:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.010147:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010151:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a8ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010180:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010184:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010188:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010193:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.010195:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010199:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010206:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.010208:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.010210:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010222:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010231:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010235:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010239:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010242:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.010245:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010249:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010254:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9c00) 00010000:00010000:2.0:1789762927.010256:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.010258:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010261:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5a8e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010282:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a8d7 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944713 expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010296:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.010298:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.010301:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a8d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944713 expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.010310:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054800, rc 0) 00000100:00100000:2.0:1789762927.010361:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12274:x1876702246594688:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 610us (761us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762927.010366:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:2.0:1789762927.011322:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.011360:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246594816 00000100:00100000:3.0:1789762927.011365:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246594816 00000100:00100000:3.0:1789762927.011412:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:3.0:1789762927.011420:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12274:x1876702246594816:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762927.011429:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.011439:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894471a expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.011470:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.011477:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.011485:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762927.011507:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762927.011509:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762927.011522:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.011554:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a8f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894471a expref: 8 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.011566:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894471a expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.011572:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:3.0:1789762927.011574:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762927.011576:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef000, rc 0) 00000100:00100000:3.0:1789762927.011610:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12274:x1876702246594816:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 190us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.011621:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:0.0:1789762927.012542:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.012609:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246595072 00000100:00100000:2.0:1789762927.012615:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246595072 00000100:00100000:2.0:1789762927.012650:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:2.0:1789762927.012658:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12274:x1876702246595072:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762927.012666:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.012676:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944721 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012729:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012738:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012744:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012793:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012800:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012807:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.012845:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00010000:00010000:2.0:1789762927.012899:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012904:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012908:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012912:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.012914:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012919:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012926:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762927.012929:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.012931:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012943:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012953:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012957:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012961:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012964:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.012967:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012971:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012976:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762927.012978:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.012979:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.012983:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a90f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.013006:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a901 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944721 expref: 9 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.013021:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762927.013023:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762927.013025:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944721 expref: 9 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.013032:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054e00, rc 0) 00000100:00100000:2.0:1789762927.013066:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:12274:x1876702246595072:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 409us (525us total) trans 4294967406 rc 301/301 00000100:00100000:2.0:1789762927.013072:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:0.0:1789762927.013946:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.014062:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246595328 00000100:00100000:1.0:1789762927.014069:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246595328 00000100:00100000:1.0:1789762927.014119:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:1.0:1789762927.014125:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:12274:x1876702246595328:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:1.0:1789762927.014175:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.014184:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.014190:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762927.014267:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000303918bb reply state 000000002108b17d transno 4294967407 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762927.014283:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762927.014288:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00000100:00100000:1.0:1789762927.014334:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12274:x1876702246595328:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 208us (398us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1789762927.014341:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 158 00010000:00010000:2.0:1789762927.014947:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.014956:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.014961:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.014965:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.014967:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.014972:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.014982:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33e0c25400) 00010000:00010000:2.0:1789762927.014984:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789762927.014986:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.014997:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7e00/0x5915dfb1c1b5a91d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.015102:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.015134:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246595584 00000100:00100000:2.0:1789762927.015140:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246595584 00000100:00100000:2.0:1789762927.015172:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:2.0:1789762927.015183:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:12274:x1876702246595584:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1789762927.015287:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12274:x1876702246595584:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 108us (185us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789762927.015293:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:2.0:1789762927.018998:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.019026:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246595712 00000100:00100000:0.0:1789762927.019033:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246595712 00000100:00100000:0.0:1789762927.019073:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:0.0:1789762927.019081:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12275:x1876702246595712:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:0.0:1789762927.019092:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762927.019102:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944728 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019132:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019140:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019147:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019166:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019171:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019176:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019213:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5a939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019219:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5a939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019223:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5a939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762927.019241:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00000004:00200000:0.0:1789762927.019243:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762927.019252:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5a939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019258:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019263:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019267:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019279:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762927.019281:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019285:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019292:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:0.0:1789762927.019294:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762927.019296:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019300:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5a92b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019308:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019311:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019315:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019318:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762927.019320:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019324:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019337:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fed74d00) 00010000:00010000:0.0:1789762927.019339:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762927.019340:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019344:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5a932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019368:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5a924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944728 expref: 12 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019378:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5a939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944728 expref: 11 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.019383:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:0.0:1789762927.019385:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762927.019386:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461c00, rc 0) 00000100:00100000:0.0:1789762927.019419:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12275:x1876702246595712:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 340us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762927.019424:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:0.0:1789762927.020578:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.020617:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246595968 00000100:00100000:1.0:1789762927.020623:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246595968 00000100:00100000:1.0:1789762927.020661:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:1.0:1789762927.020671:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12275:x1876702246595968:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:1.0:1789762927.020693:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762927.020721:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5a939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944728 expref: 11 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.020733:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:1.0:1789762927.020739:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762927.020789:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.020797:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.020803:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762927.020870:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2f5efc8 reply state 00000000fad3ce07 transno 4294967409 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762927.020876:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762927.020886:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00000100:00100000:1.0:1789762927.020931:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12275:x1876702246595968:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 263us (354us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789762927.020937:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 160 00010000:00010000:3.0:1789762927.021498:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.021507:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.021511:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.021516:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.021519:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.021524:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.021533:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33e0c25000) 00010000:00010000:3.0:1789762927.021542:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762927.021545:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.021550:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7400/0x5915dfb1c1b5a940 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.035138:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.035172:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246596096 00000100:00100000:2.0:1789762927.035182:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246596096 00000100:00100000:2.0:1789762927.035227:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:2.0:1789762927.035237:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12279:x1876702246596096:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762927.035252:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.035267:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894472f expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035312:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035322:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035328:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035346:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035354:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035361:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035420:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a95c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035426:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035431:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.035448:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1789762927.035450:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762927.035463:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035473:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035480:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035487:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035505:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.035508:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035514:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035524:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762927.035526:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.035529:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035533:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5a94e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035542:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035546:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035550:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035553:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.035555:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035559:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035575:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762927.035576:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.035578:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035582:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5a955 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035604:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5a947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894472f expref: 13 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035614:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a95c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894472f expref: 12 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.035619:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.035621:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789762927.035622:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054800, rc 0) 00000100:00100000:2.0:1789762927.035661:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12279:x1876702246596096:12345-192.168.203.36@tcp:101:dd.500 Request processed in 427us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.035666:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:0.0:1789762927.036607:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.036645:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246596352 00000100:00100000:3.0:1789762927.036653:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246596352 00000100:00100000:3.0:1789762927.036682:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:3.0:1789762927.036688:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12279:x1876702246596352:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762927.036706:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.036714:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a963 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944736 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.036791:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.036800:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.036807:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.036816:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.036821:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.036828:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762927.037119:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8:0x0], index 0: 0 00000004:00080000:3.0:1789762927.037125:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7:0x0], index 1: 0 00010000:00010000:3.0:1789762927.037211:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5a978 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037219:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5a978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037224:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5a978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037241:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037245:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037249:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037252:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cefa00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.037255:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037259:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037265:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:3.0:1789762927.037267:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.037271:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037285:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5a96a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762927.037298:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bf1c384 reply state 000000007d2cdca1 transno 4294967410 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.037307:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762927.037332:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5a963 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944736 expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037344:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5a978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944736 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.037350:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:3.0:1789762927.037353:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762927.037356:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef200, rc 0) 00000100:00100000:3.0:1789762927.037387:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12279:x1876702246596352:12345-192.168.203.36@tcp:101:dd.500 Request processed in 699us (782us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789762927.037392:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 162 00010000:00010000:3.0:1789762927.038569:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.038579:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.038584:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.038589:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.038600:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.038607:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.038619:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x3950208a (ffff9b33fec92c00) 00010000:00010000:3.0:1789762927.038623:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.038627:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.038634:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5a971 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.040038:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.040119:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246596480 00000100:00100000:3.0:1789762927.040126:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246596480 00000100:00080000:2.0:1789762927.040165:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762927.040188:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:3.0:1789762927.040198:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:12279:x1876702246596480:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762927.040209:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.040225:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5a986 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894473d expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762927.040241:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789762927.040256:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=229s v=(0 0) 00010000:00010000:3.0:1789762927.040260:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.040269:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5a986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894473d expref: 6 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.040288:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5a986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894473d expref: 6 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.040312:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0ceec00, rc 0) 00000100:00100000:3.0:1789762927.040355:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12279:x1876702246596480:12345-192.168.203.36@tcp:101:dd.500 Request processed in 157us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.040361:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1789762927.076086:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.076132:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246596736 00000100:00100000:0.0:1789762927.076151:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246596736 00000100:00100000:0.0:1789762927.076196:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:0.0:1789762927.076206:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876702246596736:12345-192.168.203.36@tcp:8:dd.500 00010000:00080000:0.0:1789762927.076254:0:6912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1789762927.076282:0:6912:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b5a98d 00002000:00100000:0.0:1789762927.076294:0:6912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f07ac6c5-9215-4651-bbbc-5b452d5bdd86/ffff9b32c5c08000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 42041344 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789762927.076309:0:6912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789762927.076392:0:6912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789762927.076423:0:6912:0:(import.c:65:import_set_state_nolock()) ffff9b32c5c0d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789762927.076496:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246596736:12345-192.168.203.36@tcp:8:dd.500 Request processed in 290us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.076506:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.076514:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:2.0:1789762927.076551:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246596608 00000100:00100000:2.0:1789762927.076557:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246596608 00002000:00100000:2.0:1789762927.076587:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x8:0x0] (0->4194303) req@ffff9b32c2e7b800 x1876702246596608/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/0 e 0 to 0 dl 1789762938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762927.076606:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c2e7b800 with x1876702246596608 ext(0->4194303) 00002000:00010000:2.0:1789762927.076611:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c2e7b800 00000100:00100000:2.0:1789762927.076629:0:12138:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 3 deadline 0 time 229513870942 state 0x0 ref 1 00000100:00100000:2.0:1789762927.076638:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 3 deadline 229563870942 time 229513870942 state 0x1 ref 1 00000100:00100000:2.0:1789762927.076661:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 229563870942 time 229513906302 state 0x0 ref 1 00000100:00100000:2.0:1789762927.076671:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246596608:12345-192.168.203.36@tcp:4:dd.500 00000001:00100000:0.0:1789762927.077275:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000100:00100000:0.0:1789762927.077442:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.077481:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246596864 00000100:00100000:3.0:1789762927.077486:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246596864 00000100:00080000:0.0:1789762927.077518:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762927.077529:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:3.0:1789762927.077537:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:12279:x1876702246596864:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762927.077546:0:12943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.077561:0:12943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000149ba908/0x5915dfb1c1b5a994 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944744 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762927.077579:0:12943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789762927.077594:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=229s v=(0 0) 00010000:00010000:3.0:1789762927.077598:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.077606:0:12943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000149ba908/0x5915dfb1c1b5a994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944744 expref: 6 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.077621:0:12943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000149ba908/0x5915dfb1c1b5a994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944744 expref: 6 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.077630:0:12943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee000, rc 0) 00000100:00100000:3.0:1789762927.077659:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12279:x1876702246596864:12345-192.168.203.36@tcp:101:dd.500 Request processed in 124us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.077672:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:2.0:1789762927.090405:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246596608:12345-192.168.203.36@tcp:4:dd.500 Request processed in 13731us (13900us total) trans 4294967530 rc 0/0 00000100:00100000:2.0:1789762927.090414:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:2.0:1789762927.090422:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 229563870942 time 229513906302 state 0x2 ref 0 00002000:00100000:2.0:1789762927.090432:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x8:0x0] (0->4194303) req@ffff9b32c2e7b800 x1876702246596608/t4294967530(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/448 e 0 to 0 dl 1789762938 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762927.090439:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c2e7b800 with x1876702246596608 ext(0->4194303) 00002000:00010000:2.0:1789762927.090443:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c2e7b800 00000100:00100000:1.0:1789762927.109340:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.109391:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246596992 00000100:00100000:2.0:1789762927.109398:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246596992 00002000:00100000:2.0:1789762927.109434:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x7:0x0] (0->4194303) req@ffff9b33ffcd2300 x1876702246596992/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/0 e 0 to 0 dl 1789762938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762927.109454:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ffcd2300 with x1876702246596992 ext(0->4194303) 00002000:00010000:2.0:1789762927.109458:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ffcd2300 00000100:00100000:2.0:1789762927.109468:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 229563870942 time 229513906302 state 0x0 ref 1 00000100:00100000:2.0:1789762927.109478:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 229563906302 time 229513906302 state 0x1 ref 1 00000100:00100000:2.0:1789762927.109499:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 229563906302 time 229546744044 state 0x0 ref 1 00000100:00100000:2.0:1789762927.109507:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246596992:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762927.121049:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246596992:12345-192.168.203.36@tcp:4:dd.500 Request processed in 11536us (11707us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789762927.121063:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:2.0:1789762927.121074:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 229563906302 time 229546744044 state 0x2 ref 0 00002000:00100000:2.0:1789762927.121090:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x7:0x0] (0->4194303) req@ffff9b33ffcd2300 x1876702246596992/t4294967327(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/448 e 0 to 0 dl 1789762938 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762927.121097:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ffcd2300 with x1876702246596992 ext(0->4194303) 00002000:00010000:2.0:1789762927.121101:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ffcd2300 00000100:00100000:0.0:1789762927.142875:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.142933:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246597120 00000100:00100000:2.0:1789762927.142943:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246597120 00002000:00100000:2.0:1789762927.142985:0:12139:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x8:0x0] (4194304->8388607) req@ffff9b33ff442d80 x1876702246597120/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/0 e 0 to 0 dl 1789762938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762927.143004:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442d80 with x1876702246597120 ext(4194304->8388607) 00002000:00010000:2.0:1789762927.143010:0:12139:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ff442d80 00000100:00100000:2.0:1789762927.143025:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 229563906302 time 229546744044 state 0x0 ref 1 00000100:00100000:2.0:1789762927.143035:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 229596744044 time 229546744044 state 0x1 ref 1 00000100:00100000:2.0:1789762927.143060:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229596744044 time 229580305001 state 0x0 ref 1 00000100:00100000:2.0:1789762927.143069:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246597120:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762927.154839:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246597120:12345-192.168.203.36@tcp:4:dd.500 Request processed in 11762us (11964us total) trans 4294967531 rc 0/0 00000100:00100000:2.0:1789762927.154852:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:2.0:1789762927.154860:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229596744044 time 229580305001 state 0x2 ref 0 00002000:00100000:2.0:1789762927.154872:0:12139:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x8:0x0] (4194304->8388607) req@ffff9b33ff442d80 x1876702246597120/t4294967531(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/448 e 0 to 0 dl 1789762938 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762927.154879:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442d80 with x1876702246597120 ext(4194304->8388607) 00002000:00010000:2.0:1789762927.154883:0:12139:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ff442d80 00000100:00100000:0.0:1789762927.179717:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.179784:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246597504 00000100:00100000:3.0:1789762927.179794:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246597504 00000100:00100000:3.0:1789762927.179840:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:3.0:1789762927.179851:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12279:x1876702246597504:12345-192.168.203.36@tcp:35:dd.500 00000100:00100000:3.0:1789762927.180089:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12279:x1876702246597504:12345-192.168.203.36@tcp:35:dd.500 Request processed in 239us (389us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789762927.180098:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:0.0:1789762927.180544:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.180595:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246597248 00000100:00100000:1.0:1789762927.180601:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246597248 00002000:00100000:1.0:1789762927.180629:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x7:0x0] (4194304->8388607) req@ffff9b33ff440700 x1876702246597248/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/0 e 0 to 0 dl 1789762938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789762927.180642:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff440700 with x1876702246597248 ext(4194304->8388607) 00002000:00010000:1.0:1789762927.180647:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff440700 00000100:00100000:1.0:1789762927.180662:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229596744044 time 229580305001 state 0x0 ref 1 00000100:00100000:1.0:1789762927.180674:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229630305001 time 229580305001 state 0x1 ref 1 00000100:00100000:2.0:1789762927.193174:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229630305001 time 229630407845 state 0x0 ref 1 00000100:00100000:2.0:1789762927.193195:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246597248:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762927.206354:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246597248:12345-192.168.203.36@tcp:4:dd.500 Request processed in 13157us (25802us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789762927.206373:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:2.0:1789762927.206383:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229630305001 time 229630407845 state 0x2 ref 0 00002000:00100000:2.0:1789762927.206397:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x7:0x0] (4194304->8388607) req@ffff9b33ff440700 x1876702246597248/t4294967328(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/448 e 0 to 0 dl 1789762938 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762927.206405:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff440700 with x1876702246597248 ext(4194304->8388607) 00002000:00010000:2.0:1789762927.206410:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff440700 00000100:00100000:0.0:1789762927.218030:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.218083:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246597760 00000100:00100000:2.0:1789762927.218093:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246597760 00000100:00100000:2.0:1789762927.218139:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 163 00000100:00100000:2.0:1789762927.218147:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12291:x1876702246597760:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762927.218170:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.218190:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a99b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894474b expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218280:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218292:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218301:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218310:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218323:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218337:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762927.218570:0:12191:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8:0x0], index 1: 0 00000004:00080000:2.0:1789762927.218574:0:12191:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9:0x0], index 0: 0 00010000:00010000:2.0:1789762927.218673:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a9b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218680:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218686:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218727:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218733:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218738:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218742:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.218745:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218769:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218786:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.218788:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.218792:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218796:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055200/0x5915dfb1c1b5a9a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762927.218806:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c381c698 reply state 000000008807e41e transno 4294967412 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.218812:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762927.218833:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054600/0x5915dfb1c1b5a99b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894474b expref: 18 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218843:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894474b expref: 17 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.218848:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff9b33ed2a9700) 00010000:00010000:2.0:1789762927.218850:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762927.218851:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054400, rc 0) 00000100:00100000:2.0:1789762927.218887:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:12291:x1876702246597760:12345-192.168.203.36@tcp:101:dd.0 Request processed in 741us (861us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789762927.218892:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 163 00010000:00010000:3.0:1789762927.219466:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.219475:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.219485:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.219489:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.219492:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.219497:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.219505:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x25a23cf0 (ffff9b33ed2a9c00) 00010000:00010000:3.0:1789762927.219507:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.219509:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.219522:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5a9a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.226090:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.226139:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246597888 00000100:00100000:2.0:1789762927.226145:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246597888 00000100:00100000:2.0:1789762927.226177:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:2.0:1789762927.226185:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12291:x1876702246597888:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762927.226199:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.226210:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944752 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762927.226225:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789762927.226238:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=229s v=(0 0) 00010000:00010000:2.0:1789762927.226241:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762927.226249:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 11 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.226259:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 11 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.226267:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054600, rc 0) 00000100:00100000:2.0:1789762927.226295:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12291:x1876702246597888:12345-192.168.203.36@tcp:101:dd.0 Request processed in 112us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.226300:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1789762927.227537:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.227579:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598016 00000100:00100000:2.0:1789762927.227584:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598016 00000100:00100000:2.0:1789762927.227613:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:2.0:1789762927.227619:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12290:x1876702246598016:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762927.227626:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.227633:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944759 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.227650:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 12 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.227662:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762927.227665:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789762927.227669:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 12 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.227711:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 12 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.227723:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 12 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.227734:0:6911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c243df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1876702254923904:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762927.227812:0:6911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c8ed2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789762927.228782:0:6911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c243df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1876702254923904:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762927.228798:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 12 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.228807:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3055200, rc 0) 00000100:00100000:2.0:1789762927.228831:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12290:x1876702246598016:12345-192.168.203.36@tcp:101:dd.0 Request processed in 1213us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.228836:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:0.0:1789762927.240595:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.240641:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598144 00000100:00100000:1.0:1789762927.240647:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598144 00000100:00100000:1.0:1789762927.240678:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:1.0:1789762927.240685:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12292:x1876702246598144:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762927.240703:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762927.240714:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944760 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.240729:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789762927.240732:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789762927.240736:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 13 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.240769:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 13 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.240777:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da7600, rc 0) 00000100:00100000:1.0:1789762927.240804:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:12292:x1876702246598144:12345-192.168.203.36@tcp:101:dd.0 Request processed in 121us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762927.240810:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:1.0:1789762927.242933:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.242970:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598272 00000100:00100000:3.0:1789762927.242976:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598272 00000100:00100000:3.0:1789762927.243005:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:3.0:1789762927.243011:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12303:x1876702246598272:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.243019:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.243030:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944767 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762927.243046:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789762927.243055:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=229s v=(0 0) 00010000:00010000:3.0:1789762927.243057:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.243063:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 11 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.243073:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 11 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.243080:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee600, rc 0) 00000100:00100000:3.0:1789762927.243106:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12303:x1876702246598272:12345-192.168.203.36@tcp:101:dd.0 Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.243111:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:0.0:1789762927.244461:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.244502:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598400 00000100:00100000:3.0:1789762927.244508:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598400 00000100:00100000:3.0:1789762927.244539:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:3.0:1789762927.244545:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:12302:x1876702246598400:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.244552:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.244560:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894476e expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.244574:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x8:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789762927.244577:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789762927.244581:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 14 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.244589:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 14 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.244596:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cefa00, rc 0) 00000100:00100000:3.0:1789762927.244620:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12302:x1876702246598400:12345-192.168.203.36@tcp:101:dd.0 Request processed in 76us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.244624:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:0.0:1789762927.245871:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.245909:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598528 00000100:00100000:3.0:1789762927.245915:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598528 00000100:00100000:3.0:1789762927.245939:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:3.0:1789762927.245945:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12305:x1876702246598528:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.245952:0:12943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.245960:0:12943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a9e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944775 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.245976:0:12943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 12 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.245987:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.245990:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762927.245994:0:12943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a9e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944775 expref: 12 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.246011:0:12943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 12 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.246020:0:12943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 12 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.246029:0:12943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12943:1876702254924032:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762927.246077:0:12943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c8a87e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789762927.247568:0:12943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12943:1876702254924032:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762927.247582:0:12943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a9e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944775 expref: 12 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.247591:0:12943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef800, rc 0) 00000100:00100000:3.0:1789762927.247614:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12305:x1876702246598528:12345-192.168.203.36@tcp:101:dd.0 Request processed in 1670us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.247620:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:0.0:1789762927.250493:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.250529:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598784 00000100:00100000:2.0:1789762927.250535:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598784 00000100:00100000:2.0:1789762927.250562:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:2.0:1789762927.250574:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12296:x1876702246598784:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762927.250582:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.250590:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5a9e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944783 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.250624:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789762927.250628:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789762927.250632:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5a9e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944783 expref: 13 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.250640:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5a9e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944783 expref: 13 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.250648:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3055000, rc 0) 00000100:00100000:2.0:1789762927.250674:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:12296:x1876702246598784:12345-192.168.203.36@tcp:101:dd.0 Request processed in 101us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.250679:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:0.0:1789762927.251907:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.251955:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598912 00000100:00100000:2.0:1789762927.251961:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598912 00000100:00100000:0.0:1789762927.251963:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.251996:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246598656 00000100:00100000:2.0:1789762927.252002:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:2.0:1789762927.252009:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:12297:x1876702246598912:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762927.252016:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.252024:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a9ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894478a expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.252038:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x9:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789762927.252047:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1789762927.252052:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a9ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894478a expref: 14 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.252060:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246598656 00010000:00010000:2.0:1789762927.252066:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a9ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894478a expref: 14 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.252076:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054000, rc 0) 00000100:00100000:3.0:1789762927.252092:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:3.0:1789762927.252106:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12301:x1876702246598656:12345-192.168.203.36@tcp:101:dd.0 00000100:00100000:2.0:1789762927.252113:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12297:x1876702246598912:12345-192.168.203.36@tcp:101:dd.0 Request processed in 101us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762927.252117:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789762927.252121:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 94 00010000:00010000:3.0:1789762927.252127:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894477c expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.252142:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x8:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789762927.252146:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789762927.252150:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 15 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.252158:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 15 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.252165:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee200, rc 0) 00000100:00100000:3.0:1789762927.252234:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12301:x1876702246598656:12345-192.168.203.36@tcp:101:dd.0 Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.252239:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:0.0:1789762927.253372:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.253416:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599040 00000100:00100000:3.0:1789762927.253421:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599040 00000100:00100000:3.0:1789762927.253446:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:3.0:1789762927.253451:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12306:x1876702246599040:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.253459:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.253467:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b5a9fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944791 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.253480:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x9:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789762927.253489:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789762927.253493:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b5a9fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944791 expref: 15 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.253502:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b5a9fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944791 expref: 15 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.253509:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ee800, rc 0) 00000100:00100000:3.0:1789762927.253534:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12306:x1876702246599040:12345-192.168.203.36@tcp:101:dd.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.253539:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:1.0:1789762927.256165:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.256221:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599168 00000100:00100000:2.0:1789762927.256225:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599168 00000100:00100000:2.0:1789762927.256255:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1789762927.256260:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:10429:x1876702246599168:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762927.256269:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789762927.256280:0:5909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789762927.256283:0:5909:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1789762927 00002000:00010000:2.0:1789762927.256285:0:5909:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1789762927 00002000:00010000:2.0:1789762927.256287:0:5909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:2.0:1789762927.256303:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000149ba908/0x5915dfb1c1b5a994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944744 expref: 15 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.256323:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762927.256353:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:10429:x1876702246599168:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.256359:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:1.0:1789762927.257742:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.257779:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599296 00000100:00100000:3.0:1789762927.257785:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599296 00000100:00100000:3.0:1789762927.257811:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:3.0:1789762927.257816:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12298:x1876702246599296:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.257823:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.257831:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b5aa04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944798 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.257844:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x9:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789762927.257847:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1789762927.257852:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b5aa04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944798 expref: 16 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.257859:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b5aa04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944798 expref: 16 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.257876:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ee000, rc 0) 00000100:00100000:3.0:1789762927.257902:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:12298:x1876702246599296:12345-192.168.203.36@tcp:101:dd.0 Request processed in 85us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.257907:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:0.0:1789762927.260870:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.260901:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.260905:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599424 00000100:00100000:2.0:1789762927.260911:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599424 00000100:00100000:2.0:1789762927.260947:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:2.0:1789762927.260955:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:12295:x1876702246599424:12345-192.168.203.36@tcp:101:dd.0 00000100:00100000:3.0:1789762927.260961:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599552 00010000:00010000:2.0:1789762927.260963:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789762927.260967:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599552 00010000:00010000:2.0:1789762927.260974:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aa0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894479f expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.260994:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x9:0x0].0x0 since=0s v=(5 0) 00010000:00010000:2.0:1789762927.260999:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(6 0) 00000100:00100000:3.0:1789762927.261003:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00010000:00010000:2.0:1789762927.261011:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aa0b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 8 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894479f expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.261015:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:5430:x1876702246599552:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762927.261026:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762927.261032:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aa0b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 8 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894479f expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762927.261036:0:5954:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789762927.261041:0:5954:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1789762927 00002000:00010000:3.0:1789762927.261043:0:5954:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1789762927 00010000:00010000:2.0:1789762927.261044:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054c00, rc 0) 00002000:00010000:3.0:1789762927.261049:0:5954:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:3.0:1789762927.261063:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5a986 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894473d expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.261077:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762927.261081:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:12295:x1876702246599424:12345-192.168.203.36@tcp:101:dd.0 Request processed in 126us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.261087:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:3.0:1789762927.261104:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:5430:x1876702246599552:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.261110:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1789762927.263518:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.263551:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599680 00000100:00100000:2.0:1789762927.263556:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599680 00000100:00100000:2.0:1789762927.263582:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:2.0:1789762927.263588:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12299:x1876702246599680:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762927.263595:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.263601:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447a6 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.263625:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x8:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789762927.263628:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(5 0) 00010000:00010000:2.0:1789762927.263632:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 15 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.263639:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 15 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.263645:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3055a00, rc 0) 00000100:00100000:2.0:1789762927.263671:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12299:x1876702246599680:12345-192.168.203.36@tcp:101:dd.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.263675:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:1.0:1789762927.265889:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.265911:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.265944:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599808 00000100:00100000:3.0:1789762927.265944:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246599936 00000100:00100000:3.0:1789762927.265949:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599936 00000100:00100000:0.0:1789762927.265952:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246599808 00000100:00100000:3.0:1789762927.265980:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:3.0:1789762927.265989:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:12300:x1876702246599936:12345-192.168.203.36@tcp:101:dd.0 00000100:00100000:0.0:1789762927.266001:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 101 00010000:00010000:3.0:1789762927.266007:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789762927.266016:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:12294:x1876702246599808:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.266019:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447b4 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.266029:0:12943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.266035:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x8:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1789762927.266040:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1789762927.266041:0:12943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447ad expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.266047:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 17 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.266070:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.266078:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x8:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1789762927.266085:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.266092:0:12943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.266104:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13efc00, rc 0) 00010000:00010000:0.0:1789762927.266107:0:12943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.266120:0:12943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461000, rc 0) 00000100:00100000:3.0:1789762927.266133:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:12300:x1876702246599936:12345-192.168.203.36@tcp:101:dd.0 Request processed in 146us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.266140:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:0.0:1789762927.266152:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:12294:x1876702246599808:12345-192.168.203.36@tcp:101:dd.0 Request processed in 139us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762927.266160:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:0.0:1789762927.270531:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.270583:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246600064 00000100:00100000:1.0:1789762927.270589:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246600064 00002000:00100000:1.0:1789762927.270615:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (4194304->5242879) req@ffff9b33ff442680 x1876702246600064/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/0 e 0 to 0 dl 1789762938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762927.270624:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442680 with x1876702246600064 ext(4194304->5242879) 00010000:00010000:1.0:1789762927.270629:0:6916:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 16 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.270638:0:6916:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 16 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762927.270644:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b33ff442680 00000100:00100000:1.0:1789762927.270669:0:6916:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b32c4e29600 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3700 gen 0 rate 10000 depth 3 token 3 deadline 0 time 229707910979 state 0x0 ref 1 00000100:00100000:1.0:1789762927.270678:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29600 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3700 gen 0 rate 10000 depth 3 token 3 deadline 229708010979 time 229707910979 state 0x1 ref 1 00000100:00100000:1.0:1789762927.270717:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29600 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3700 gen 0 rate 10000 depth 3 token 2 deadline 229708010979 time 229707960488 state 0x0 ref 1 00000100:00100000:1.0:1789762927.270725:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2356:x1876702246600064:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762927.271023:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.271066:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246600192 00000100:00100000:2.0:1789762927.271072:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246600192 00002000:00100000:2.0:1789762927.271101:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (1048576->2097151) req@ffff9b33ff443b80 x1876702246600192/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/0 e 0 to 0 dl 1789762938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762927.271109:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff443b80 with x1876702246600192 ext(1048576->2097151) 00010000:00010000:2.0:1789762927.271115:0:12137:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 17 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.271125:0:12137:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 17 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762927.271131:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b33ff443b80 00000100:00100000:2.0:1789762927.271143:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29600 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3700 gen 0 rate 10000 depth 3 token 2 deadline 229708060488 time 229707960488 state 0x1 ref 2 00000100:00100000:2.0:1789762927.271194:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29600 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3700 gen 0 rate 10000 depth 3 token 2 deadline 229708060488 time 229708435971 state 0x0 ref 2 00000100:00100000:2.0:1789762927.271209:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:2353:x1876702246600192:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762927.272059:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.272095:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246600320 00000100:00100000:3.0:1789762927.272101:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246600320 00000100:00100000:3.0:1789762927.272130:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:3.0:1789762927.272136:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:12304:x1876702246600320:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.272144:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.272152:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b5aa27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447bb expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.272166:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x9:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789762927.272169:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:3.0:1789762927.272180:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b5aa27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447bb expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.272189:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b5aa27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447bb expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.272197:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13eec00, rc 0) 00000100:00100000:3.0:1789762927.272225:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:12304:x1876702246600320:12345-192.168.203.36@tcp:101:dd.0 Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.272230:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:3.0:1789762927.276936:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2356:x1876702246600064:12345-192.168.203.36@tcp:4:dd.0 Request processed in 6207us (6402us total) trans 4294967532 rc 0/0 00000100:00100000:2.0:1789762927.276937:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2353:x1876702246600192:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5729us (5913us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789762927.276955:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:2.0:1789762927.276962:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 1 00002000:00100000:3.0:1789762927.276966:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (4194304->5242879) req@ffff9b33ff442680 x1876702246600064/t4294967532(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/448 e 0 to 0 dl 1789762938 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789762927.276979:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29600 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3700 gen 0 rate 10000 depth 3 token 2 deadline 229708060488 time 229708435971 state 0x2 ref 0 00002000:00100000:3.0:1789762927.276985:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442680 with x1876702246600064 ext(4194304->5242879) 00010000:00010000:3.0:1789762927.276995:0:6916:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 19 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1789762927.276996:0:12137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8:0x0] (1048576->2097151) req@ffff9b33ff443b80 x1876702246600192/t4294967329(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/448 e 0 to 0 dl 1789762938 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762927.277019:0:12137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff443b80 with x1876702246600192 ext(1048576->2097151) 00010000:00010000:3.0:1789762927.277023:0:6916:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 19 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.277029:0:12137:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 19 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762927.277035:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b33ff442680 00010000:00010000:2.0:1789762927.277046:0:12137:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 19 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762927.277053:0:12137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b33ff443b80 00000100:00100000:1.0:1789762927.281127:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.281180:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246600448 00000100:00100000:0.0:1789762927.281186:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246600448 00010000:00010000:0.0:1789762927.281208:0:7992:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 19 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.281255:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:0.0:1789762927.281265:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2355:x1876702246600448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762927.281276:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789762927.281286:0:7992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1789762927.281289:0:7992:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1789762927 00002000:00010000:0.0:1789762927.281292:0:7992:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1789762927 00002000:00010000:0.0:1789762927.281295:0:7992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1789762927.281300:0:7992:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 19 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281312:0:7992:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 19 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281330:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077d8715a/0x5915dfb1c1b5a9be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944752 expref: 19 pid: 6909 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281343:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281347:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281355:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281365:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281385:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281388:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281394:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281403:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281411:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281414:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281419:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 18 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281428:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 18 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281435:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281438:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281443:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 18 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281452:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 18 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281460:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281468:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281474:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281483:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281490:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281493:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281499:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281509:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281516:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281519:0:7992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281524:0:7992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281533:0:7992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281565:0:7992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.281579:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ff442a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924160:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.281594:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.281671:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246600576 00010000:00010000:0.0:1789762927.281677:0:7992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.281677:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246600576 00000100:00100000:0.0:1789762927.281706:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ff440000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924288:192.168.203.36@tcp:105: 00010000:00010000:3.0:1789762927.281709:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 19 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.281792:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:2.0:1789762927.281802:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:2355:x1876702246600576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762927.281810:0:7992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281812:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789762927.281823:0:5910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb size from disk: 0 -> 5242880 00000100:00100000:0.0:1789762927.281829:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffd8b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924416:192.168.203.36@tcp:105: 00002000:00010000:2.0:1789762927.281835:0:5910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1789762927 00002000:00010000:2.0:1789762927.281838:0:5910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1789762927 00002000:00010000:2.0:1789762927.281840:0:5910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1789762927.281846:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 19 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281858:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 19 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281871:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5a9d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944767 expref: 19 pid: 7959 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281881:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.281884:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789762927.281890:0:7992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 18 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281891:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a9e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944775 expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281913:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944775 expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281920:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00000100:00100000:0.0:1789762927.281922:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffd89880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924544:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.281923:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.281932:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5a9e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944783 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281939:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5a9e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944783 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281954:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.281956:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.281961:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894478a expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.281964:0:7992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 18 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281973:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a9ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894478a expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.281986:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00000100:00100000:0.0:1789762927.281989:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffd8b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924672:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.281990:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.282000:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b5a9fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944791 expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282006:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b5a9fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944791 expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282011:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.282013:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.282017:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b5aa04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [3145728->5242879] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944798 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282023:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b5aa04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [3145728->5242879] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944798 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282027:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.282033:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.282043:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aa0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894479f expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.282044:0:7992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282058:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aa0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894479f expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282069:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00000100:00100000:0.0:1789762927.282072:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffd89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924800:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.282073:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(7 0) 00010000:00010000:2.0:1789762927.282081:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b5aa27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447bb expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282087:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b5aa27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447bb expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.282106:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b5aa27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447bb expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.282116:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c243d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254924928:192.168.203.36@tcp:105: 00010000:00010000:0.0:1789762927.282126:0:7992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.282154:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffd8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254925056:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.282165:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aa0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894479f expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.282182:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7699180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925184:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762927.282187:0:7992:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c589b6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789762927.282220:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b5aa04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [3145728->5242879] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944798 expref: 18 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.282239:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925312:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.282277:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b5a9fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944791 expref: 18 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.282285:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f463c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925440:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.282304:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a9ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894478a expref: 18 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.282310:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1728000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925568:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.282327:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5a9e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944783 expref: 18 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.282332:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c172aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925696:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.282351:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944775 expref: 18 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.282357:0:5910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925824:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.282371:0:5910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c8ed2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789762927.282822:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ff442a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924160:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.282830:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ff440000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924288:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.293501:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffd8b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924416:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.293523:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffd89880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924544:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.293538:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffd8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254925056:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762927.293553:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7699180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925184:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.293559:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffd8b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924672:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762927.293578:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925312:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762927.293596:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f463c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925440:192.168.203.36@tcp:105: 00000100:00100000:2.0:1789762927.293603:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffd89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7992:1876702254924800:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762927.293617:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1728000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925568:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762927.293638:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c243d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254924928:192.168.203.36@tcp:105: 00010000:00010000:2.0:1789762927.293640:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762927.293673:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:2355:x1876702246600448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 12410us (12546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.293680:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:0.0:1789762927.297442:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c172aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925696:192.168.203.36@tcp:105: 00000100:00100000:0.0:1789762927.297452:0:5910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5910:1876702254925824:192.168.203.36@tcp:105: 00010000:00010000:0.0:1789762927.297476:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762927.297507:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:2355:x1876702246600576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 15708us (15914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762927.297517:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:3.0:1789762927.415916:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.415976:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246600832 00000100:00100000:1.0:1789762927.415985:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246600832 00000100:00100000:1.0:1789762927.416040:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:1.0:1789762927.416048:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:12340:x1876702246600832:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762927.416068:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762927.416083:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5aa2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447c2 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.416184:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5aa35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.416197:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.416210:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762927.416223:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00010000:00010000:1.0:1789762927.416316:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da7000/0x5915dfb1c1b5aa2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447c2 expref: 20 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.416349:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5aa35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447c2 expref: 19 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.416357:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:1.0:1789762927.416359:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762927.416362:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da6400, rc 0) 00000100:00100000:1.0:1789762927.416411:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:12340:x1876702246600832:12345-192.168.203.36@tcp:101:dd.0 Request processed in 364us (503us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789762927.416416:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:1.0:1789762927.418667:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.418717:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246601088 00000100:00100000:0.0:1789762927.418723:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246601088 00000100:00100000:0.0:1789762927.418806:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:0.0:1789762927.418816:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:12331:x1876702246601088:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762927.418825:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762927.418835:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5aa43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447c9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.418874:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254925952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789762927.418896:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aa4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.418905:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aa4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.418913:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aa4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762927.418919:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00000100:00100000:2.0:1789762927.418925:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762927.418960:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254925952 00000100:00100000:1.0:1789762927.418965:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254925952 00010000:00010000:0.0:1789762927.418981:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5aa43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447c9 expref: 22 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.418995:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aa4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447c9 expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.419002:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:0.0:1789762927.419004:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762927.419007:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461a00, rc 0) 00000100:00100000:1.0:1789762927.419016:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789762927.419019:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762927.419027:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254925952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762927.419044:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:12331:x1876702246601088:12345-192.168.203.36@tcp:101:dd.0 Request processed in 229us (376us total) trans 4294967414 rc 0/0 00002000:00000024:1.0:1789762927.419044:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 494428736 pending 9510912 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762927.419055:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:1.0:1789762927.419095:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254925952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762927.419103:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789762927.419190:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254925952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762927.420115:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.420179:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246601344 00000100:00100000:1.0:1789762927.420184:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246601344 00000100:00100000:1.0:1789762927.420215:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:1.0:1789762927.420222:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:12334:x1876702246601344:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762927.420230:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762927.420238:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5aa58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447d0 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.420289:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5aa5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.420297:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5aa5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.420303:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5aa5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762927.420309:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00010000:00010000:1.0:1789762927.420371:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6800/0x5915dfb1c1b5aa58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447d0 expref: 24 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.420381:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5aa5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447d0 expref: 23 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.420387:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:1.0:1789762927.420389:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762927.420391:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da6000, rc 0) 00000100:00100000:1.0:1789762927.420418:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:12334:x1876702246601344:12345-192.168.203.36@tcp:101:dd.0 Request processed in 197us (304us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789762927.420423:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:2.0:1789762927.425979:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.426024:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246601600 00000100:00100000:0.0:1789762927.426030:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246601600 00000100:00100000:0.0:1789762927.426059:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:0.0:1789762927.426065:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:12338:x1876702246601600:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762927.426082:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762927.426089:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5aa6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447d7 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.426127:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5aa74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.426135:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5aa74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.426141:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5aa74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762927.426147:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00010000:00010000:0.0:1789762927.426192:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5aa6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447d7 expref: 26 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.426202:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5aa74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447d7 expref: 25 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.426208:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:0.0:1789762927.426210:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789762927.426211:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461400, rc 0) 00000100:00100000:0.0:1789762927.426240:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:12338:x1876702246601600:12345-192.168.203.36@tcp:101:dd.0 Request processed in 176us (264us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789762927.426246:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:0.0:1789762927.427282:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.427326:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246601856 00000100:00100000:3.0:1789762927.427332:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246601856 00000100:00100000:3.0:1789762927.427361:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:3.0:1789762927.427369:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:12328:x1876702246601856:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.427377:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.427385:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b5aa82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447de expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.427422:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5aa89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.427429:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5aa89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.427436:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5aa89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762927.427441:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 16777216 00010000:00010000:3.0:1789762927.427490:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef000/0x5915dfb1c1b5aa82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447de expref: 28 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.427505:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5aa89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447de expref: 27 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.427529:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:3.0:1789762927.427532:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789762927.427535:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13ef600, rc 0) 00000100:00100000:3.0:1789762927.427569:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:12328:x1876702246601856:12345-192.168.203.36@tcp:101:dd.0 Request processed in 200us (287us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789762927.427577:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:1.0:1789762927.432629:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.432668:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246601984 00000100:00100000:3.0:1789762927.432675:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246601984 00000100:00100000:3.0:1789762927.432722:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:3.0:1789762927.432729:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:2355:x1876702246601984:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762927.432739:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762927.432777:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6400/0x5915dfb1c1b5aa35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447c2 expref: 27 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.432789:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:3.0:1789762927.432793:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762927.432817:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2355:x1876702246601984:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 90us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.432823:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:2.0:1789762927.432968:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.433011:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246602112 00000100:00100000:1.0:1789762927.433017:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246602112 00000100:00100000:1.0:1789762927.433053:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:1.0:1789762927.433065:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:12340:x1876702246602112:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762927.433080:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762927.433092:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447e5 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762927.433109:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 8388608, mtime: 0x6aad9d6f, atime: 0x0, ctime: 0x6aad9d6f, blocks: 0x4000 00010000:00010000:1.0:1789762927.433120:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=229s v=(0 0) 00010000:00010000:1.0:1789762927.433124:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762927.433132:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 19 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.433142:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 19 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.433150:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c4da6800, rc 0) 00000100:00100000:1.0:1789762927.433176:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:12340:x1876702246602112:12345-192.168.203.36@tcp:101:dd.0 Request processed in 116us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762927.433181:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:0.0:1789762927.433918:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.433953:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246602240 00000100:00100000:3.0:1789762927.433959:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246602240 00000100:00100000:3.0:1789762927.433989:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:3.0:1789762927.433997:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:12336:x1876702246602240:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762927.434004:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.434011:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447ec expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.434034:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.434038:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.434046:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 20 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.434060:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 20 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.434070:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c13efa00, rc 0) 00000100:00100000:3.0:1789762927.434100:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:12336:x1876702246602240:12345-192.168.203.36@tcp:101:dd.0 Request processed in 103us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.434107:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:0.0:1789762927.434672:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.434740:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246602496 00000100:00100000:2.0:1789762927.434746:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246602496 00000100:00100000:2.0:1789762927.434817:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:0.0:1789762927.434821:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.434832:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:12331:x1876702246602496:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:3.0:1789762927.434847:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246602624 00000100:00100000:3.0:1789762927.434852:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246602624 00000100:00100000:3.0:1789762927.434930:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1789762927.434941:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:2356:x1876702246602624:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762927.434952:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762927.434965:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12331:x1876702246602496:12345-192.168.203.36@tcp:35:dd.0 Request processed in 134us (290us total) trans 4294967418 rc 0/0 00010000:00010000:3.0:1789762927.434968:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aa4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447c9 expref: 28 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.434983:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00010000:00010000:3.0:1789762927.434988:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:3.0:1789762927.434992:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762927.435022:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2356:x1876702246602624:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.435100:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:0.0:1789762927.435890:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.435939:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246602752 00000100:00100000:2.0:1789762927.435945:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246602752 00000100:00100000:2.0:1789762927.435982:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1789762927.435992:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2356:x1876702246602752:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762927.436002:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762927.436022:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c4da6000/0x5915dfb1c1b5aa5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447d0 expref: 26 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.436035:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:2.0:1789762927.436039:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762927.436071:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:2356:x1876702246602752:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 81us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.436080:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:0.0:1789762927.438922:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.438963:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246602880 00000100:00100000:1.0:1789762927.438968:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246602880 00002000:00100000:1.0:1789762927.438991:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x8:0x0] (0->1048575) req@ffff9b33ffd8ad80 x1876702246602880/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/0 e 0 to 0 dl 1789762938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762927.438999:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ffd8ad80 with x1876702246602880 ext(0->1048575) 00002000:00010000:1.0:1789762927.439002:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ffd8ad80 00000100:00100000:1.0:1789762927.439025:0:6915:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 3 deadline 0 time 229876263654 state 0x0 ref 1 00000100:00100000:1.0:1789762927.439038:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 3 deadline 229876363654 time 229876263654 state 0x1 ref 1 00000100:00100000:1.0:1789762927.439074:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 229876363654 time 229876317233 state 0x0 ref 1 00000100:00100000:1.0:1789762927.439083:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2354:x1876702246602880:12345-192.168.203.36@tcp:3:dd.0 00000100:00100000:0.0:1789762927.439906:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.439940:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246603136 00000100:00100000:3.0:1789762927.440239:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246603136 00000100:00100000:3.0:1789762927.440265:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:3.0:1789762927.440271:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:12334:x1876702246603136:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:3.0:1789762927.440389:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:12334:x1876702246603136:12345-192.168.203.36@tcp:35:dd.0 Request processed in 117us (483us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789762927.440395:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1789762927.441389:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.441456:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246603264 00000100:00100000:3.0:1789762927.441460:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246603264 00000100:00100000:3.0:1789762927.441486:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1789762927.441491:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2355:x1876702246603264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762927.441498:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762927.441509:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c13ef600/0x5915dfb1c1b5aa89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447de expref: 26 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.441519:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:3.0:1789762927.441521:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762927.441544:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:2355:x1876702246603264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.441549:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:0.0:1789762927.442409:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.442441:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246603520 00000100:00100000:2.0:1789762927.442447:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246603520 00000100:00100000:2.0:1789762927.442474:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:2.0:1789762927.442489:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:12338:x1876702246603520:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762927.442574:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:12338:x1876702246603520:12345-192.168.203.36@tcp:35:dd.0 Request processed in 93us (164us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789762927.442580:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:3.0:1789762927.442739:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2354:x1876702246602880:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3655us (3816us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762927.442746:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:3.0:1789762927.442788:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 229876363654 time 229876317233 state 0x2 ref 0 00002000:00100000:3.0:1789762927.442797:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x8:0x0] (0->1048575) req@ffff9b33ffd8ad80 x1876702246602880/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:708/0 lens 488/440 e 0 to 0 dl 1789762938 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762927.442811:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ffd8ad80 with x1876702246602880 ext(0->1048575) 00002000:00010000:3.0:1789762927.442814:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ffd8ad80 00000100:00100000:1.0:1789762927.449032:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.449075:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246603776 00000100:00100000:3.0:1789762927.449080:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246603776 00000100:00100000:3.0:1789762927.449112:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:3.0:1789762927.449123:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:12328:x1876702246603776:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:3.0:1789762927.449206:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:12328:x1876702246603776:12345-192.168.203.36@tcp:35:dd.0 Request processed in 87us (177us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789762927.449212:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:1.0:1789762927.479348:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.479402:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246604032 00000100:00100000:2.0:1789762927.479412:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246604032 00000100:00100000:2.0:1789762927.479455:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:2.0:1789762927.479462:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:12306:x1876702246604032:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762927.479713:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12306:x1876702246604032:12345-192.168.203.36@tcp:35:dd.0 Request processed in 251us (372us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789762927.479720:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00010000:00010000:3.0:1789762927.482831:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762927.504389:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.504436:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246604160 00000100:00100000:2.0:1789762927.504442:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246604160 00000100:00100000:2.0:1789762927.504479:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:2.0:1789762927.504485:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12342:x1876702246604160:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:2.0:1789762927.504508:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.504523:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aaa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447f3 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.504569:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5aaac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.504581:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5aaac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.504588:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5aaac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.504610:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1789762927.504613:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762927.504624:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5aaac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.504641:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aaa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447f3 expref: 30 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.504652:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5aaac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447f3 expref: 29 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.504659:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.504661:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762927.504664:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054e00, rc 0) 00000100:00100000:2.0:1789762927.504705:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:12342:x1876702246604160:12345-192.168.203.36@tcp:101:rm.0 Request processed in 210us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.504711:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:1.0:1789762927.506036:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.506078:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246604416 00000100:00100000:3.0:1789762927.506083:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246604416 00000100:00100000:3.0:1789762927.506121:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:3.0:1789762927.506131:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:12342:x1876702246604416:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762927.506141:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.506149:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789447fa expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762927.506194:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00010000:00010000:3.0:1789762927.506254:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aab3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447fa expref: 31 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.506263:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:3.0:1789762927.506265:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762927.506268:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447fa expref: 31 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.506284:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461a00, rc 0) 00000100:00100000:3.0:1789762927.506312:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12342:x1876702246604416:12345-192.168.203.36@tcp:101:rm.0 Request processed in 184us (277us total) trans 4294967423 rc 301/301 00000100:00100000:3.0:1789762927.506317:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:1.0:1789762927.507719:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.507762:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246604544 00000100:00100000:3.0:1789762927.507767:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246604544 00000100:00100000:3.0:1789762927.507792:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:3.0:1789762927.507797:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12342:x1876702246604544:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:3.0:1789762927.509542:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12342:x1876702246604544:12345-192.168.203.36@tcp:37:rm.0 Request processed in 1744us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.509548:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:1.0:1789762927.510914:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.510945:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246604800 00000100:00100000:2.0:1789762927.510951:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246604800 00000100:00100000:2.0:1789762927.510979:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:2.0:1789762927.510985:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12342:x1876702246604800:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762927.511066:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:12342:x1876702246604800:12345-192.168.203.36@tcp:35:rm.0 Request processed in 80us (152us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789762927.511071:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:1.0:1789762927.511979:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762927.512026:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246605056 00000100:00100000:0.0:1789762927.512031:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246605056 00000100:00100000:0.0:1789762927.512062:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:0.0:1789762927.512069:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:12342:x1876702246605056:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1789762927.512079:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762927.512087:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c5c35000/0x5915dfb1c1b5aac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944801 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.512125:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c5c35a00/0x5915dfb1c1b5aac8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.512133:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c5c35a00/0x5915dfb1c1b5aac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.512139:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c5c35a00/0x5915dfb1c1b5aac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762927.512144:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00010000:00010000:0.0:1789762927.512182:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c5c35000/0x5915dfb1c1b5aac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944801 expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.512192:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c5c35a00/0x5915dfb1c1b5aac8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944801 expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.512204:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:0.0:1789762927.512206:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789762927.512208:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c5c35a00, rc 0) 00000100:00100000:0.0:1789762927.512234:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246605056:12345-192.168.203.36@tcp:101:rm.0 Request processed in 167us (257us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1789762927.512240:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:0.0:1789762927.513010:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762927.513061:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246605184 00000100:00100000:1.0:1789762927.513067:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246605184 00000100:00100000:1.0:1789762927.513097:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:1.0:1789762927.513106:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246605184:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:1.0:1789762927.513132:0:5926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7374782464 00000100:00100000:1.0:1789762927.513166:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246605184:12345-192.168.203.36@tcp:41:rm.0 Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762927.513172:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:1.0:1789762927.513960:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.513989:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246605440 00000100:00100000:3.0:1789762927.513994:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246605440 00000100:00100000:3.0:1789762927.514018:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:3.0:1789762927.514024:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246605440:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762927.514103:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12342:x1876702246605440:12345-192.168.203.36@tcp:35:rm.0 Request processed in 78us (142us total) trans 4294967426 rc 0/0 00000100:00100000:3.0:1789762927.514108:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:0.0:1789762927.514883:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.514923:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246605696 00000100:00100000:2.0:1789762927.514929:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246605696 00000100:00100000:2.0:1789762927.514959:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:2.0:1789762927.514966:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12342:x1876702246605696:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762927.514990:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762927.515001:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5aa74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447d7 expref: 34 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515013:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5a978 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944736 expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515020:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:2.0:1789762927.515028:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5aaac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447f3 expref: 32 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515034:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.515036:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762927.515045:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515060:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515066:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515075:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515080:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515084:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515133:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515140:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515147:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762927.515335:0:9183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8704 00000004:00080000:2.0:1789762927.515345:0:9183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 229952593095ns, next at 230952590801ns, rc = 0 00000040:00080000:2.0:1789762927.515371:0:9183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8640 00000004:00080000:2.0:1789762927.515377:0:9183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 229952625993ns, next at 230952625023ns, rc = 0 00010000:00010000:2.0:1789762927.515409:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515430:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515436:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515442:0:9183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515446:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515450:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515467:0:9183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762927.515477:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515481:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515486:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515491:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.515491:0:8854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762927.515498:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.515500:0:8854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515505:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.515513:0:8854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762927.515517:0:8854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515530:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33ed2a9e00) 00010000:00010000:2.0:1789762927.515537:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762927.515543:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.515543:0:8854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515561:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5aae4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.515566:0:8854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9b33ed2a9e00) 00010000:00010000:3.0:1789762927.515570:0:8854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762927.515573:0:8854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515574:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.515583:0:8854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5aaeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515586:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515599:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515603:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.515605:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762927.515606:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.515609:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762927.515613:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762927.515615:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515622:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.515624:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.515626:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.515629:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5aad6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762927.515645:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032679a6f reply state 000000006f210409 transno 4294967427 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.515651:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762927.515686:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246605696:12345-192.168.203.36@tcp:36:rm.0 Request processed in 720us (803us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1789762927.515691:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 173 00010000:00010000:3.0:1789762927.516316:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.516322:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.516327:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.516330:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.516333:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.516337:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.516343:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x3950208a (ffff9b33ed2a9f00) 00010000:00010000:3.0:1789762927.516350:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.516353:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.516357:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5aadd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.517746:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.517828:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246605952 00000100:00100000:3.0:1789762927.517833:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246605952 00000100:00100000:3.0:1789762927.517860:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:3.0:1789762927.517867:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12342:x1876702246605952:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:3.0:1789762927.517887:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762927.517897:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5a9b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894474b expref: 32 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517907:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff9b33ed2a9700) 00010000:00010000:3.0:1789762927.517912:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762927.517919:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517927:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517932:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517939:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517944:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517958:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517987:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517993:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.517997:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789762927.518071:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8704 00000040:00080000:3.0:1789762927.518080:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8768 00010000:00010000:3.0:1789762927.518099:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518106:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518111:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518115:0:5924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518119:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518124:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518152:0:5924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762927.518164:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518172:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518179:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518185:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.518188:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518194:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518201:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff9b33fec92700) 00010000:00010000:0.0:1789762927.518203:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762927.518204:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762927.518208:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.518211:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518215:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.518226:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762927.518230:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518233:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.518239:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518241:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.518258:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff9b33fec92700) 00010000:00010000:0.0:1789762927.518264:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762927.518267:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.518268:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518284:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762927.518285:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5ab07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518288:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518296:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.518300:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762927.518304:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:3.0:1789762927.518306:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.518308:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.518310:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762927.518314:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762927.518315:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5aaf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762927.518324:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcaadd35 reply state 00000000a1a564dd transno 4294967428 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.518330:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762927.518362:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246605952:12345-192.168.203.36@tcp:36:rm.0 Request processed in 496us (617us total) trans 4294967428 rc 0/0 00000100:00100000:3.0:1789762927.518367:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 174 00010000:00010000:3.0:1789762927.518822:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518828:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518840:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518844:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.518846:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518850:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518857:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x25a23cf0 (ffff9b33fec92200) 00010000:00010000:3.0:1789762927.518858:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.518860:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.518865:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5aaf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.534439:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.534473:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246606208 00000100:00100000:2.0:1789762927.534479:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246606208 00000100:00100000:2.0:1789762927.534509:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:2.0:1789762927.534516:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12342:x1876702246606208:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762927.534603:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246606208:12345-192.168.203.36@tcp:35:rm.0 Request processed in 88us (166us total) trans 4294967429 rc 0/0 00000100:00100000:2.0:1789762927.534609:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:0.0:1789762927.535325:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.535358:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246606464 00000100:00100000:2.0:1789762927.535362:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246606464 00000100:00100000:2.0:1789762927.535387:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:2.0:1789762927.535392:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12342:x1876702246606464:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762927.535410:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762927.535420:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c5c35a00/0x5915dfb1c1b5aac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944801 expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535435:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5a95c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894472f expref: 32 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535443:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.535461:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5a8fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894471a expref: 31 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535468:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762927.535471:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762927.535481:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535488:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535493:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535500:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535505:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535510:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535540:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535545:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535550:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.535633:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00010000:00010000:2.0:1789762927.535646:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535651:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535655:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535658:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.535660:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535665:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535670:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9b33ed2a9b00) 00010000:00010000:2.0:1789762927.535672:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762927.535674:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535678:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535688:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535707:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535711:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535722:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.535724:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535728:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535734:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762927.535735:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.535737:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.535741:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055c00/0x5915dfb1c1b5ab0e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762927.535748:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ebdb735 reply state 00000000876ed670 transno 4294967430 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.535771:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762927.535804:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12342:x1876702246606464:12345-192.168.203.36@tcp:36:rm.0 Request processed in 411us (480us total) trans 4294967430 rc 0/0 00000100:00100000:2.0:1789762927.535810:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 175 00010000:00010000:3.0:1789762927.536337:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.536346:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.536350:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.536354:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.536356:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.536370:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.536377:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9d00) 00010000:00010000:3.0:1789762927.536379:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.536381:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.536385:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab15 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.810479:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.810568:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246606592 00000100:00100000:3.0:1789762927.810578:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246606592 00000100:00100000:3.0:1789762927.810626:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:3.0:1789762927.810636:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:12353:x1876702246606592:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:3.0:1789762927.810659:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.810683:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944808 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.810781:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5ab2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.810793:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.810804:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762927.810840:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762927.810848:0:7598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762927.810865:0:7598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.810885:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944808 expref: 33 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.810897:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5ab2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944808 expref: 32 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.810903:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92200) 00010000:00010000:3.0:1789762927.810905:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762927.810908:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461a00, rc 0) 00000100:00100000:3.0:1789762927.810956:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12353:x1876702246606592:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 323us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.810962:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:0.0:1789762927.811967:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.812009:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246606848 00000100:00100000:2.0:1789762927.812015:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246606848 00000100:00100000:2.0:1789762927.812060:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:2.0:1789762927.812072:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12353:x1876702246606848:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:2.0:1789762927.812105:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762927.812122:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5ab2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944808 expref: 32 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812149:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92200) 00010000:00010000:2.0:1789762927.812161:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762927.812202:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812212:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812220:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812233:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812241:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812249:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.812663:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00010000:00010000:2.0:1789762927.812672:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812681:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812689:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812710:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.812722:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812731:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812741:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762927.812745:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.812772:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.812781:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762927.812802:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a7a259e reply state 000000006c278eba transno 4294967431 ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762927.812810:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762927.812859:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12353:x1876702246606848:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 790us (893us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789762927.812869:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 177 00010000:00010000:3.0:1789762927.813380:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.813388:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.813392:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.813396:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.813398:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.813402:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.813418:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9b00) 00010000:00010000:3.0:1789762927.813421:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.813424:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.813431:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054e00/0x5915dfb1c1b5ab38 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.817458:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.817540:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246606976 00000100:00100000:3.0:1789762927.817545:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246606976 00000100:00100000:3.0:1789762927.817577:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:3.0:1789762927.817584:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12354:x1876702246606976:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762927.817594:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.817603:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894480f expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.817630:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.817637:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.817645:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762927.817666:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762927.817670:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762927.817683:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.817726:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894480f expref: 34 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.817737:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894480f expref: 33 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.817743:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92000) 00010000:00010000:3.0:1789762927.817745:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762927.817747:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460200, rc 0) 00000100:00100000:3.0:1789762927.817802:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12354:x1876702246606976:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 217us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.817809:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:0.0:1789762927.818808:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.818842:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246607232 00000100:00100000:2.0:1789762927.818849:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246607232 00000100:00100000:2.0:1789762927.818888:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:2.0:1789762927.818900:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12354:x1876702246607232:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762927.818909:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.818912:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789762927.818927:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5ab46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894480f expref: 33 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.818953:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92000) 00010000:00010000:2.0:1789762927.818963:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762927.818973:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab4d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944816 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819045:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819056:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819065:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819078:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819086:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819099:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819147:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819155:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819163:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.819180:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00010000:00010000:2.0:1789762927.819191:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819199:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819206:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819212:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.819216:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819223:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819233:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9100) 00010000:00010000:2.0:1789762927.819236:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.819239:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819246:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055400/0x5915dfb1c1b5ab62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819262:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819269:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819288:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819294:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.819298:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819305:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819314:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762927.819318:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.819321:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819328:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055600/0x5915dfb1c1b5ab54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819337:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819345:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819351:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819356:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.819358:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819378:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819388:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.819390:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.819394:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819401:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5ab5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819427:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab4d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944816 expref: 33 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819436:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762927.819439:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.819442:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5ab4d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944816 expref: 33 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.819453:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054800, rc 0) 00000100:00100000:2.0:1789762927.819489:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12354:x1876702246607232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 592us (684us total) trans 0 rc 301/301 00000100:00100000:2.0:1789762927.819497:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:2.0:1789762927.820388:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.820423:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246607360 00000100:00100000:3.0:1789762927.820429:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246607360 00000100:00100000:3.0:1789762927.820475:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:3.0:1789762927.820486:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12354:x1876702246607360:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762927.820497:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.820509:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5ab69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894481d expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.820535:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5ab70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.820543:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5ab70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.820548:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5ab70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762927.820571:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762927.820573:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762927.820581:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5ab70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.820595:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5ab69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894481d expref: 34 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.820610:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5ab70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894481d expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.820618:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92500) 00010000:00010000:3.0:1789762927.820621:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762927.820623:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460400, rc 0) 00000100:00100000:3.0:1789762927.820659:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12354:x1876702246607360:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 175us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762927.820665:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:0.0:1789762927.821589:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.821630:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246607616 00000100:00100000:2.0:1789762927.821636:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246607616 00000100:00100000:2.0:1789762927.821672:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:2.0:1789762927.821681:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12354:x1876702246607616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762927.821736:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.821747:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5ab77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944824 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821808:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821819:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821829:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821841:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821850:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821858:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.821899:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00010000:00010000:2.0:1789762927.821942:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821951:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821958:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821974:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.821978:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821984:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.821994:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92500) 00010000:00010000:2.0:1789762927.821997:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.822000:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822007:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5ab7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822018:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822024:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822030:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822036:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.822040:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822046:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822067:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9300) 00010000:00010000:2.0:1789762927.822070:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.822074:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822080:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5ab85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822110:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5ab77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944824 expref: 35 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822120:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92500) 00010000:00010000:2.0:1789762927.822123:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789762927.822128:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5ab77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944824 expref: 35 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.822140:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054a00, rc 0) 00000100:00100000:2.0:1789762927.822175:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12354:x1876702246607616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 495us (587us total) trans 4294967432 rc 301/301 00000100:00100000:2.0:1789762927.822183:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:0.0:1789762927.823042:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.823076:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246607872 00000100:00100000:3.0:1789762927.823082:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246607872 00000100:00100000:3.0:1789762927.823111:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:3.0:1789762927.823117:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12354:x1876702246607872:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1789762927.823161:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823170:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823176:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762927.823252:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4564b1c reply state 000000007c820739 transno 4294967433 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.823258:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762927.823262:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00000100:00100000:3.0:1789762927.823304:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:12354:x1876702246607872:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 186us (262us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789762927.823310:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 182 00010000:00010000:3.0:1789762927.823938:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823949:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823954:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823959:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.823962:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823967:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823977:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33fec92600) 00010000:00010000:3.0:1789762927.823979:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762927.823982:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.823987:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5ab93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.823992:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.824036:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246608128 00000100:00100000:2.0:1789762927.824042:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246608128 00000100:00100000:2.0:1789762927.824084:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:2.0:1789762927.824093:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12354:x1876702246608128:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1789762927.824195:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:12354:x1876702246608128:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 103us (204us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789762927.824204:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:0.0:1789762927.827667:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.827716:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246608256 00000100:00100000:2.0:1789762927.827722:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246608256 00000100:00100000:2.0:1789762927.827799:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:2.0:1789762927.827810:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:12355:x1876702246608256:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:2.0:1789762927.827822:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.827831:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5ab9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894482b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827860:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827871:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827879:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827893:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827901:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827909:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827946:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5abaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827956:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5abaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.827975:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5abaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.827994:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00000004:00200000:2.0:1789762927.827997:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762927.828006:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5abaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828015:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828020:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828027:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828031:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.828035:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828041:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828052:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92500) 00010000:00010000:2.0:1789762927.828055:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.828059:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828065:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5aba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828086:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828093:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828099:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828106:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.828110:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828116:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828125:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9300) 00010000:00010000:2.0:1789762927.828128:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.828131:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828139:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5aba8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828164:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5ab9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894482b expref: 38 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828177:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5abaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894482b expref: 37 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.828195:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:2.0:1789762927.828198:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762927.828200:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054800, rc 0) 00000100:00100000:2.0:1789762927.828239:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:12355:x1876702246608256:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 431us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.828246:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:0.0:1789762927.829202:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.829232:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246608512 00000100:00100000:3.0:1789762927.829239:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246608512 00000100:00100000:3.0:1789762927.829268:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 184 00000100:00100000:3.0:1789762927.829275:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:12355:x1876702246608512:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:3.0:1789762927.829294:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762927.829304:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054800/0x5915dfb1c1b5abaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894482b expref: 37 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829315:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9400) 00010000:00010000:3.0:1789762927.829320:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762927.829330:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829338:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829343:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762927.829405:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c91ff965 reply state 00000000b77f108a transno 4294967435 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.829411:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762927.829414:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00000100:00100000:3.0:1789762927.829451:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:12355:x1876702246608512:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 176us (250us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789762927.829456:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 184 00010000:00010000:3.0:1789762927.829937:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829949:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829953:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829957:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.829960:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829964:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829972:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33fec92600) 00010000:00010000:3.0:1789762927.829974:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789762927.829976:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.829980:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.847416:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.847482:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246608640 00000100:00100000:2.0:1789762927.847491:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246608640 00000100:00100000:2.0:1789762927.847536:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:2.0:1789762927.847547:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:12361:x1876702246608640:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762927.847568:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762927.847596:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5abbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944832 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847645:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847657:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847665:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847674:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847679:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847709:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847833:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5abd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847843:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5abd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847849:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5abd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762927.847872:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00000004:00200000:2.0:1789762927.847875:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762927.847889:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5abd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847898:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847903:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847908:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847912:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.847915:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847920:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847935:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92500) 00010000:00010000:2.0:1789762927.847938:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.847941:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847945:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054200/0x5915dfb1c1b5abc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847954:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847958:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847962:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847966:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762927.847967:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847971:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847975:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2a9300) 00010000:00010000:2.0:1789762927.847976:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762927.847978:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.847983:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3055800/0x5915dfb1c1b5abcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.848023:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054a00/0x5915dfb1c1b5abbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944832 expref: 39 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.848037:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5abd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944832 expref: 38 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.848043:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762927.848044:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789762927.848046:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b32c3054400, rc 0) 00000100:00100000:2.0:1789762927.848092:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:12361:x1876702246608640:12345-192.168.203.36@tcp:101:dd.500 Request processed in 549us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762927.848098:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:0.0:1789762927.849035:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.849085:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246608896 00000100:00100000:3.0:1789762927.849091:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246608896 00000100:00100000:3.0:1789762927.849124:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 186 00000100:00100000:3.0:1789762927.849130:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:12361:x1876702246608896:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762927.849138:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762927.849147:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944839 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849213:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849227:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849233:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849242:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849249:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849256:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762927.849532:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa:0x0], index 0: 0 00010000:00010000:3.0:1789762927.849623:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5abee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849629:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5abee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849634:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5abee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849659:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849666:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849674:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849687:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.849702:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849710:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849717:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:3.0:1789762927.849718:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.849721:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849724:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5abe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762927.849732:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ae4f542 reply state 00000000f9ee3bc0 transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.849738:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762927.849773:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5abd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944839 expref: 41 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849785:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5abee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944839 expref: 40 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.849790:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9b33fec92800) 00010000:00010000:3.0:1789762927.849792:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762927.849794:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460a00, rc 0) 00000100:00100000:3.0:1789762927.849826:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:12361:x1876702246608896:12345-192.168.203.36@tcp:101:dd.500 Request processed in 696us (793us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789762927.849837:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 186 00010000:00010000:3.0:1789762927.850653:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.850662:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.850668:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.850675:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762927.850700:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.850711:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.850718:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x4009f790 (ffff9b33fec92600) 00010000:00010000:3.0:1789762927.850719:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762927.850722:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.850725:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5abe7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762927.853308:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.853357:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609024 00000100:00100000:2.0:1789762927.853362:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609024 00000100:00100000:2.0:1789762927.853410:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229630305001 time 229630407845 state 0x0 ref 1 00000100:00100000:2.0:1789762927.853424:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 229680407845 time 229630407845 state 0x1 ref 1 00000100:00100000:2.0:1789762927.853453:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 229680407845 time 230290695392 state 0x0 ref 1 00000100:00100000:2.0:1789762927.853466:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+20:2353:x1876702246609024:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762927.853497:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789762927.853505:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.853529:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:2.0:1789762927.853534:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762927.853541:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.853554:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762927.858826:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967533 is committed 00002000:00010000:3.0:1789762927.858903:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789762927.858908:0:12138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1789762928 00002000:00010000:3.0:1789762927.858910:0:12138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1789762928 00002000:00010000:3.0:1789762927.858911:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1789762927.858919:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.858938:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.858947:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.858955:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762927.858960:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.858970:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.858986:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.858991:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5abfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.859040:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246609024:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5576us (5732us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789762927.859048:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:3.0:1789762927.859056:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 229680407845 time 230290695392 state 0x2 ref 0 00000100:00100000:0.0:1789762927.867008:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.867051:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609152 00000100:00100000:3.0:1789762927.867060:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609152 00000100:00100000:3.0:1789762927.867106:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 229680407845 time 230290695392 state 0x0 ref 1 00000100:00100000:3.0:1789762927.867121:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 2 deadline 230340695392 time 230290695392 state 0x1 ref 1 00000100:00100000:3.0:1789762927.867155:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 230340695392 time 230304397071 state 0x0 ref 1 00000100:00100000:3.0:1789762927.867172:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609152:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762927.867202:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 1048576, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x800 00010000:00010000:3.0:1789762927.867211:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.867224:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789762927.867229:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.867235:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.867248:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762927.872781:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967534 is committed 00002000:00010000:1.0:1789762927.872867:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1789762927.872872:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:1.0:1789762927.872879:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.872888:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.872904:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.872909:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762927.872912:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.872927:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.872937:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762927.872942:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5ac03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762927.872997:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609152:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5829us (5989us total) trans 4294967534 rc 0/0 00000100:00100000:1.0:1789762927.873006:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1789762927.873024:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 230340695392 time 230304397071 state 0x2 ref 0 00000100:00100000:0.0:1789762927.874957:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762927.875005:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609280 00000100:00100000:2.0:1789762927.875011:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609280 00000100:00100000:2.0:1789762927.875044:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 230340695392 time 230304397071 state 0x0 ref 1 00000100:00100000:2.0:1789762927.875056:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 1 deadline 230354397071 time 230304397071 state 0x1 ref 1 00000100:00100000:2.0:1789762927.875083:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230354397071 time 230312325924 state 0x0 ref 1 00000100:00100000:2.0:1789762927.875097:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609280:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762927.875130:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 2097152, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x1000 00010000:00010000:2.0:1789762927.875137:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.875147:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:2.0:1789762927.875151:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762927.875162:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762927.875173:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762927.880218:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967535 is committed 00002000:00010000:3.0:1789762927.880286:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1789762927.880291:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:3.0:1789762927.880298:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.880306:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.880322:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.880327:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762927.880329:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.880335:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.880344:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.880349:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.880390:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609280:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5296us (5433us total) trans 4294967535 rc 0/0 00000100:00100000:3.0:1789762927.880396:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:3.0:1789762927.880402:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230354397071 time 230312325924 state 0x2 ref 0 00000100:00100000:2.0:1789762927.882291:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.882324:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609408 00000100:00100000:3.0:1789762927.882330:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609408 00000100:00100000:3.0:1789762927.882354:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230354397071 time 230312325924 state 0x0 ref 1 00000100:00100000:3.0:1789762927.882372:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230362325924 time 230312325924 state 0x1 ref 1 00000100:00100000:3.0:1789762927.925145:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230362325924 time 230362377157 state 0x0 ref 1 00000100:00100000:3.0:1789762927.925167:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609408:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762927.925224:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 3145728, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x1800 00010000:00010000:3.0:1789762927.925231:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.925244:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789762927.925247:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762927.925252:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.925263:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762927.930435:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967536 is committed 00002000:00010000:3.0:1789762927.930537:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1789762927.930543:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:3.0:1789762927.930556:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.930569:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.930593:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.930602:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762927.930607:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.930617:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.930647:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.930656:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.930741:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609408:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5579us (48447us total) trans 4294967536 rc 0/0 00000100:00100000:3.0:1789762927.930783:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:3.0:1789762927.930795:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230362325924 time 230362377157 state 0x2 ref 0 00000100:00100000:1.0:1789762927.932946:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.932980:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609536 00000100:00100000:3.0:1789762927.932988:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609536 00000100:00100000:3.0:1789762927.933024:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230362325924 time 230362377157 state 0x0 ref 1 00000100:00100000:3.0:1789762927.933042:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230412377157 time 230362377157 state 0x1 ref 1 00000100:00100000:0.0:1789762927.975226:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230412377157 time 230412458548 state 0x0 ref 1 00000100:00100000:0.0:1789762927.975247:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609536:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762927.975293:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 4194304, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x2000 00010000:00010000:0.0:1789762927.975300:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.975314:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:0.0:1789762927.975317:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762927.975336:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762927.975352:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762927.980630:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967537 is committed 00002000:00010000:3.0:1789762927.980707:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1789762927.980712:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:3.0:1789762927.980721:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.980729:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.980736:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.980740:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c5c34200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762927.980744:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.980766:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.980783:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762927.980792:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0625d13/0x5915dfb1c1b5ac18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762927.980861:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609536:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5619us (47915us total) trans 4294967537 rc 0/0 00000100:00100000:3.0:1789762927.980870:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:3.0:1789762927.980878:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230412377157 time 230412458548 state 0x2 ref 0 00000100:00100000:0.0:1789762927.983003:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762927.983036:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609664 00000100:00100000:3.0:1789762927.983045:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609664 00000100:00100000:3.0:1789762927.983079:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230412377157 time 230412458548 state 0x0 ref 1 00000100:00100000:3.0:1789762927.983090:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230462458548 time 230412458548 state 0x1 ref 1 00000100:00100000:1.0:1789762928.025309:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230462458548 time 230462544962 state 0x0 ref 1 00000100:00100000:1.0:1789762928.025328:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246609664:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.025382:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 5242880, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x2800 00010000:00010000:1.0:1789762928.025388:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.025400:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:1.0:1789762928.025403:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.025414:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.025424:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.030033:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967538 is committed 00002000:00010000:1.0:1789762928.030099:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1789762928.030104:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:1.0:1789762928.030111:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.030120:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.030130:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.030137:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762928.030142:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.030166:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.030183:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.030189:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762928.030237:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246609664:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4915us (47234us total) trans 4294967538 rc 0/0 00000100:00100000:1.0:1789762928.030244:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1789762928.030252:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230462458548 time 230462544962 state 0x2 ref 0 00000100:00100000:2.0:1789762928.032284:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.032326:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609792 00000100:00100000:3.0:1789762928.032334:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609792 00000100:00100000:3.0:1789762928.032370:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230462458548 time 230462544962 state 0x0 ref 1 00000100:00100000:3.0:1789762928.032380:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230512544962 time 230462544962 state 0x1 ref 1 00000100:00100000:1.0:1789762928.075384:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230512544962 time 230512616091 state 0x0 ref 1 00000100:00100000:1.0:1789762928.075403:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609792:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.075444:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 6291456, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x3000 00010000:00010000:1.0:1789762928.075452:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.075464:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:1.0:1789762928.075468:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.075472:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.075491:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.080585:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967539 is committed 00002000:00010000:3.0:1789762928.080654:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1789762928.080659:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:3.0:1789762928.080668:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.080676:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.080705:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.080711:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.080714:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.080721:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.080733:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.080739:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ac26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.080807:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246609792:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5409us (48523us total) trans 4294967539 rc 0/0 00000100:00100000:3.0:1789762928.080814:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1789762928.080821:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230512544962 time 230512616091 state 0x2 ref 0 00000100:00100000:0.0:1789762928.082887:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.082922:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246609920 00000100:00100000:3.0:1789762928.082929:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246609920 00000100:00100000:3.0:1789762928.082965:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230512544962 time 230512616091 state 0x0 ref 1 00000100:00100000:3.0:1789762928.082991:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230562616091 time 230512616091 state 0x1 ref 1 00000100:00100000:1.0:1789762928.125493:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230562616091 time 230562714365 state 0x0 ref 1 00000100:00100000:1.0:1789762928.125515:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246609920:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.125575:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 7340032, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x3800 00010000:00010000:1.0:1789762928.125582:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.125595:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:1.0:1789762928.125599:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.125603:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.125614:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.130914:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967540 is committed 00002000:00010000:3.0:1789762928.130969:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1789762928.130974:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:3.0:1789762928.130982:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.130991:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.130997:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.131002:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.131005:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.131012:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.131024:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.131030:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5ac2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.131090:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246609920:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5581us (48203us total) trans 4294967540 rc 0/0 00000100:00100000:3.0:1789762928.131097:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1789762928.131105:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230562616091 time 230562714365 state 0x2 ref 0 00000100:00100000:0.0:1789762928.133379:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762928.133458:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610048 00000100:00100000:1.0:1789762928.133466:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610048 00000100:00100000:1.0:1789762928.133502:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230562616091 time 230562714365 state 0x0 ref 1 00000100:00100000:1.0:1789762928.133513:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230612714365 time 230562714365 state 0x1 ref 1 00000100:00100000:1.0:1789762928.175556:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230612714365 time 230612787791 state 0x0 ref 1 00000100:00100000:1.0:1789762928.175576:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610048:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.175624:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 8388608, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x4000 00010000:00010000:1.0:1789762928.175632:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.175645:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:1.0:1789762928.175649:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.175654:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.175665:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.180392:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967541 is committed 00002000:00010000:1.0:1789762928.180508:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:1.0:1789762928.180514:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:1.0:1789762928.180524:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.180532:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.180539:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.180554:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762928.180558:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.180565:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.180578:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.180583:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ac34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762928.180640:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610048:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5069us (47261us total) trans 4294967541 rc 0/0 00000100:00100000:1.0:1789762928.180650:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:1.0:1789762928.180660:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230612714365 time 230612787791 state 0x2 ref 0 00000100:00100000:0.0:1789762928.182802:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.182841:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610176 00000100:00100000:3.0:1789762928.182849:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610176 00000100:00100000:3.0:1789762928.182884:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230612714365 time 230612787791 state 0x0 ref 1 00000100:00100000:3.0:1789762928.182894:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230662787791 time 230612787791 state 0x1 ref 1 00000100:00100000:2.0:1789762928.225617:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230662787791 time 230662848247 state 0x0 ref 1 00000100:00100000:2.0:1789762928.225636:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610176:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762928.225680:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 9437184, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x4800 00010000:00010000:2.0:1789762928.225710:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.225728:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:2.0:1789762928.225733:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762928.225740:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.225793:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762928.230440:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967542 is committed 00002000:00010000:2.0:1789762928.230519:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:2.0:1789762928.230524:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 18432 -> 20480 00010000:00010000:2.0:1789762928.230533:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.230541:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.230547:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.230552:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762928.230556:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.230562:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.230575:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.230580:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ac3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762928.230641:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610176:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5010us (47839us total) trans 4294967542 rc 0/0 00000100:00100000:2.0:1789762928.230649:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:2.0:1789762928.230657:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230662787791 time 230662848247 state 0x2 ref 0 00000100:00100000:0.0:1789762928.232644:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.232678:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610304 00000100:00100000:3.0:1789762928.232697:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610304 00000100:00100000:3.0:1789762928.232736:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230662787791 time 230662848247 state 0x0 ref 1 00000100:00100000:3.0:1789762928.232774:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230712848247 time 230662848247 state 0x1 ref 1 00000100:00100000:3.0:1789762928.275659:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230712848247 time 230712895458 state 0x0 ref 1 00000100:00100000:3.0:1789762928.275676:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610304:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762928.275725:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 10485760, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x5000 00010000:00010000:3.0:1789762928.275732:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.275766:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789762928.275770:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762928.275775:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.275786:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.280335:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967543 is committed 00002000:00010000:3.0:1789762928.280437:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:3.0:1789762928.280441:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 20480 -> 22528 00010000:00010000:3.0:1789762928.280449:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.280457:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.280463:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.280468:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.280471:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.280478:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.280501:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.280507:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.280555:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610304:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4883us (47912us total) trans 4294967543 rc 0/0 00000100:00100000:3.0:1789762928.280561:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:3.0:1789762928.280568:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230712848247 time 230712895458 state 0x2 ref 0 00000100:00100000:0.0:1789762928.282562:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762928.282609:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610432 00000100:00100000:1.0:1789762928.282616:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610432 00000100:00100000:1.0:1789762928.282649:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230712848247 time 230712895458 state 0x0 ref 1 00000100:00100000:1.0:1789762928.282659:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230762895458 time 230712895458 state 0x1 ref 1 00000100:00100000:0.0:1789762928.325732:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230762895458 time 230762967739 state 0x0 ref 1 00000100:00100000:0.0:1789762928.325765:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610432:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762928.325806:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 11534336, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x5800 00010000:00010000:0.0:1789762928.325814:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762928.325824:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:0.0:1789762928.325828:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762928.325832:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762928.325843:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.330395:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967544 is committed 00002000:00010000:3.0:1789762928.330457:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:3.0:1789762928.330462:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 22528 -> 24576 00010000:00010000:3.0:1789762928.330470:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.330479:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.330485:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.330489:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c5c34c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.330492:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.330508:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.330520:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.330525:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084af0ef2/0x5915dfb1c1b5ac49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.330573:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610432:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4828us (48011us total) trans 4294967544 rc 0/0 00000100:00100000:3.0:1789762928.330580:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1789762928.330588:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230762895458 time 230762967739 state 0x2 ref 0 00000100:00100000:0.0:1789762928.332589:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762928.332664:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610560 00000100:00100000:2.0:1789762928.332671:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610560 00000100:00100000:2.0:1789762928.332722:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230762895458 time 230762967739 state 0x0 ref 1 00000100:00100000:2.0:1789762928.332732:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230812967739 time 230762967739 state 0x1 ref 1 00000100:00100000:1.0:1789762928.376088:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230812967739 time 230813317015 state 0x0 ref 1 00000100:00100000:1.0:1789762928.376129:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610560:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.376188:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 12582912, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x6000 00010000:00010000:1.0:1789762928.376196:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.376209:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:1.0:1789762928.376214:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.376218:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.376229:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.381303:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967545 is committed 00002000:00010000:3.0:1789762928.381362:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:3.0:1789762928.381367:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:3.0:1789762928.381376:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.381385:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.381391:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.381406:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.381410:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.381417:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.381431:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.381436:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ac50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.381489:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610560:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5370us (48900us total) trans 4294967545 rc 0/0 00000100:00100000:3.0:1789762928.381497:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:3.0:1789762928.381505:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230812967739 time 230813317015 state 0x2 ref 0 00000100:00100000:2.0:1789762928.383557:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.383589:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610688 00000100:00100000:3.0:1789762928.383598:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610688 00000100:00100000:3.0:1789762928.383632:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230812967739 time 230813317015 state 0x0 ref 1 00000100:00100000:3.0:1789762928.383643:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230863317015 time 230813317015 state 0x1 ref 1 00000100:00100000:3.0:1789762928.426133:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230863317015 time 230863370541 state 0x0 ref 1 00000100:00100000:3.0:1789762928.426156:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610688:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762928.426187:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 13631488, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x6800 00010000:00010000:3.0:1789762928.426193:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.426203:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789762928.426206:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762928.426210:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.426220:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.430850:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967546 is committed 00002000:00010000:3.0:1789762928.430928:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:3.0:1789762928.430933:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 26624 -> 28672 00010000:00010000:3.0:1789762928.430941:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.430949:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.430955:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.430960:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.430969:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.430976:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.430987:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.430992:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.431039:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610688:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4886us (47483us total) trans 4294967546 rc 0/0 00000100:00100000:3.0:1789762928.431046:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:3.0:1789762928.431054:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230863317015 time 230863370541 state 0x2 ref 0 00000100:00100000:1.0:1789762928.433008:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.433042:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610816 00000100:00100000:3.0:1789762928.433049:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610816 00000100:00100000:3.0:1789762928.433079:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230863317015 time 230863370541 state 0x0 ref 1 00000100:00100000:3.0:1789762928.433088:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230913370541 time 230863370541 state 0x1 ref 1 00000100:00100000:3.0:1789762928.476190:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230913370541 time 230913427418 state 0x0 ref 1 00000100:00100000:3.0:1789762928.476206:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610816:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762928.476245:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 14680064, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x7000 00010000:00010000:3.0:1789762928.476251:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.476261:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1789762928.476264:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762928.476268:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.476278:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.480801:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967547 is committed 00002000:00010000:3.0:1789762928.480865:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:3.0:1789762928.480869:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 28672 -> 30720 00010000:00010000:3.0:1789762928.480875:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.480883:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.480889:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.480893:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.480897:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.480912:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.480923:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.480928:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ac5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.480974:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246610816:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4772us (47967us total) trans 4294967547 rc 0/0 00000100:00100000:3.0:1789762928.480982:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1789762928.480990:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230913370541 time 230913427418 state 0x2 ref 0 00000100:00100000:1.0:1789762928.482890:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.482920:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246610944 00000100:00100000:3.0:1789762928.482926:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246610944 00000100:00100000:3.0:1789762928.482955:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230913370541 time 230913427418 state 0x0 ref 1 00000100:00100000:3.0:1789762928.482963:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230963427418 time 230913427418 state 0x1 ref 1 00010000:00010000:2.0:1789762928.506882:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762928.526290:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230963427418 time 230963528327 state 0x0 ref 1 00000100:00100000:1.0:1789762928.526306:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610944:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.526338:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 15728640, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x7800 00010000:00010000:1.0:1789762928.526344:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.526354:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=230s v=(0 0) 00010000:00010000:1.0:1789762928.526358:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.526371:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.526381:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.531080:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967548 is committed 00002000:00010000:3.0:1789762928.531130:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:3.0:1789762928.531135:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 30720 -> 32768 00010000:00010000:3.0:1789762928.531143:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.531168:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.531177:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.531186:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.531191:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.531201:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.531213:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.531219:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.531263:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246610944:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4961us (48373us total) trans 4294967548 rc 0/0 00000100:00100000:3.0:1789762928.531270:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1789762928.531278:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230963427418 time 230963528327 state 0x2 ref 0 00000100:00100000:0.0:1789762928.533185:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.533218:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611072 00000100:00100000:3.0:1789762928.533230:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611072 00000100:00100000:3.0:1789762928.533258:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 230963427418 time 230963528327 state 0x0 ref 1 00000100:00100000:3.0:1789762928.533267:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231013528327 time 230963528327 state 0x1 ref 1 00000100:00100000:2.0:1789762928.576396:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231013528327 time 231013629021 state 0x0 ref 1 00000100:00100000:2.0:1789762928.576426:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611072:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762928.576468:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 16777216, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x8000 00010000:00010000:2.0:1789762928.576477:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.576507:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:2.0:1789762928.576512:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762928.576519:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.576538:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.581485:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967549 is committed 00002000:00010000:3.0:1789762928.581548:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:3.0:1789762928.581553:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 32768 -> 34816 00010000:00010000:3.0:1789762928.581561:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.581570:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.581577:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.581582:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.581585:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.581592:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.581604:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.581609:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ac6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.581666:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611072:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5255us (48482us total) trans 4294967549 rc 0/0 00000100:00100000:3.0:1789762928.581673:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:3.0:1789762928.581681:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231013528327 time 231013629021 state 0x2 ref 0 00000100:00100000:2.0:1789762928.584530:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.584578:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611200 00000100:00100000:3.0:1789762928.584587:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611200 00000100:00100000:3.0:1789762928.584631:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231013528327 time 231013629021 state 0x0 ref 1 00000100:00100000:3.0:1789762928.584644:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231063629021 time 231013629021 state 0x1 ref 1 00000100:00100000:2.0:1789762928.626469:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231063629021 time 231063705501 state 0x0 ref 1 00000100:00100000:2.0:1789762928.626487:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611200:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762928.626525:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 17825792, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x8800 00010000:00010000:2.0:1789762928.626533:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.626545:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:2.0:1789762928.626548:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762928.626553:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.626564:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.631171:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967550 is committed 00002000:00010000:3.0:1789762928.631271:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:3.0:1789762928.631276:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 34816 -> 36864 00010000:00010000:3.0:1789762928.631284:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.631293:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.631299:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.631304:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.631307:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.631321:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.631333:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.631338:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ac73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.631392:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611200:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4909us (46868us total) trans 4294967550 rc 0/0 00000100:00100000:3.0:1789762928.631398:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:3.0:1789762928.631405:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231063629021 time 231063705501 state 0x2 ref 0 00000100:00100000:2.0:1789762928.633392:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.633424:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611328 00000100:00100000:3.0:1789762928.633432:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611328 00000100:00100000:3.0:1789762928.633463:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231063629021 time 231063705501 state 0x0 ref 1 00000100:00100000:3.0:1789762928.633473:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231113705501 time 231063705501 state 0x1 ref 1 00000100:00100000:0.0:1789762928.676542:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231113705501 time 231113779203 state 0x0 ref 1 00000100:00100000:0.0:1789762928.676558:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611328:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762928.676587:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 18874368, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x9000 00010000:00010000:0.0:1789762928.676593:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762928.676603:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:0.0:1789762928.676606:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762928.676609:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762928.676619:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.681221:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967551 is committed 00002000:00010000:3.0:1789762928.681319:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:3.0:1789762928.681324:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 36864 -> 38912 00010000:00010000:3.0:1789762928.681332:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.681352:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.681357:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.681362:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c5c35400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.681365:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.681372:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.681383:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.681387:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381ac995/0x5915dfb1c1b5ac7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.681438:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611328:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4883us (48046us total) trans 4294967551 rc 0/0 00000100:00100000:3.0:1789762928.681444:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:3.0:1789762928.681451:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231113705501 time 231113779203 state 0x2 ref 0 00000100:00100000:1.0:1789762928.683376:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.683409:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611456 00000100:00100000:3.0:1789762928.683422:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611456 00000100:00100000:3.0:1789762928.683450:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231113705501 time 231113779203 state 0x0 ref 1 00000100:00100000:3.0:1789762928.683459:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231163779203 time 231113779203 state 0x1 ref 1 00000100:00100000:1.0:1789762928.726646:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231163779203 time 231163883359 state 0x0 ref 1 00000100:00100000:1.0:1789762928.726663:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611456:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.726709:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 19922944, mtime: 0x6aad9d70, atime: 0x0, ctime: 0x6aad9d70, blocks: 0x9800 00010000:00010000:1.0:1789762928.726715:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.726725:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762928.726729:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.726733:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.726743:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.731128:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967552 is committed 00002000:00010000:1.0:1789762928.731236:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:1.0:1789762928.731240:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 1789762928 -> 1789762929 00002000:00010000:1.0:1789762928.731242:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 1789762928 -> 1789762929 00002000:00010000:1.0:1789762928.731244:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 38912 -> 40960 00010000:00010000:1.0:1789762928.731258:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.731266:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.731272:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.731277:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762928.731280:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.731287:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.731298:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.731303:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762928.731352:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611456:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4693us (47975us total) trans 4294967552 rc 0/0 00000100:00100000:1.0:1789762928.731358:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:1.0:1789762928.731366:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231163779203 time 231163883359 state 0x2 ref 0 00000100:00100000:0.0:1789762928.733301:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.733345:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611584 00000100:00100000:3.0:1789762928.733351:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611584 00000100:00100000:3.0:1789762928.733381:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231163779203 time 231163883359 state 0x0 ref 1 00000100:00100000:3.0:1789762928.733390:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231213883359 time 231163883359 state 0x1 ref 1 00000100:00100000:1.0:1789762928.776799:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231213883359 time 231214031578 state 0x0 ref 1 00000100:00100000:1.0:1789762928.776821:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611584:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.776869:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 20971520, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xa000 00010000:00010000:1.0:1789762928.776876:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.776889:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762928.776893:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.776897:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.776908:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.781417:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967553 is committed 00002000:00010000:1.0:1789762928.781526:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:1.0:1789762928.781531:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 40960 -> 43008 00010000:00010000:1.0:1789762928.781539:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.781548:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.781555:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.781570:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762928.781574:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.781580:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.781593:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.781598:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762928.781651:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611584:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4836us (48350us total) trans 4294967553 rc 0/0 00000100:00100000:1.0:1789762928.781657:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:1.0:1789762928.781665:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231213883359 time 231214031578 state 0x2 ref 0 00000100:00100000:2.0:1789762928.783800:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.783842:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611712 00000100:00100000:3.0:1789762928.783851:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611712 00000100:00100000:3.0:1789762928.783887:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231213883359 time 231214031578 state 0x0 ref 1 00000100:00100000:3.0:1789762928.783897:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231264031578 time 231214031578 state 0x1 ref 1 00000100:00100000:1.0:1789762928.826887:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231264031578 time 231264123031 state 0x0 ref 1 00000100:00100000:1.0:1789762928.826903:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611712:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.826936:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 22020096, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xa800 00010000:00010000:1.0:1789762928.826942:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.826962:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762928.826965:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.826969:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.826980:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.831455:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967554 is committed 00002000:00010000:3.0:1789762928.831515:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:3.0:1789762928.831520:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 43008 -> 45056 00010000:00010000:3.0:1789762928.831528:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.831536:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.831542:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.831557:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.831560:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.831567:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.831578:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.831583:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ac8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.831634:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611712:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4735us (47834us total) trans 4294967554 rc 0/0 00000100:00100000:3.0:1789762928.831643:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:3.0:1789762928.831651:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231264031578 time 231264123031 state 0x2 ref 0 00000100:00100000:0.0:1789762928.833696:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762928.833747:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611840 00000100:00100000:1.0:1789762928.833770:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611840 00000100:00100000:1.0:1789762928.833804:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231264031578 time 231264123031 state 0x0 ref 1 00000100:00100000:1.0:1789762928.833814:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231314123031 time 231264123031 state 0x1 ref 1 00000100:00100000:1.0:1789762928.876955:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231314123031 time 231314192413 state 0x0 ref 1 00000100:00100000:1.0:1789762928.876972:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611840:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762928.877006:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 23068672, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xb000 00010000:00010000:1.0:1789762928.877012:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.877023:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762928.877026:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762928.877031:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.877050:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.881424:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967555 is committed 00002000:00010000:1.0:1789762928.881498:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:1.0:1789762928.881503:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 45056 -> 47104 00010000:00010000:1.0:1789762928.881511:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.881519:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.881526:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.881530:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762928.881534:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.881552:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.881564:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762928.881569:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ac96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762928.881624:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246611840:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4656us (47941us total) trans 4294967555 rc 0/0 00000100:00100000:1.0:1789762928.881642:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:1.0:1789762928.881650:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231314123031 time 231314192413 state 0x2 ref 0 00000100:00100000:0.0:1789762928.883881:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762928.883938:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246611968 00000100:00100000:1.0:1789762928.883946:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246611968 00000100:00100000:1.0:1789762928.883978:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231314123031 time 231314192413 state 0x0 ref 1 00000100:00100000:1.0:1789762928.883988:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231364192413 time 231314192413 state 0x1 ref 1 00000100:00100000:2.0:1789762928.927017:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231364192413 time 231364252682 state 0x0 ref 1 00000100:00100000:2.0:1789762928.927035:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611968:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762928.927068:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 24117248, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xb800 00010000:00010000:2.0:1789762928.927075:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.927085:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:2.0:1789762928.927089:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762928.927093:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762928.927102:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.931606:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967556 is committed 00002000:00010000:3.0:1789762928.931662:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:3.0:1789762928.931667:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 47104 -> 49152 00010000:00010000:3.0:1789762928.931675:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.931696:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.931713:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.931718:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.931722:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.931728:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.931741:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.931746:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7466c3c/0x5915dfb1c1b5ac9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.931810:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246611968:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4780us (47930us total) trans 4294967556 rc 0/0 00000100:00100000:3.0:1789762928.931817:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:3.0:1789762928.931824:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231364192413 time 231364252682 state 0x2 ref 0 00000100:00100000:0.0:1789762928.933861:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762928.933895:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612096 00000100:00100000:3.0:1789762928.933903:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612096 00000100:00100000:3.0:1789762928.933942:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231364192413 time 231364252682 state 0x0 ref 1 00000100:00100000:3.0:1789762928.933963:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231414252682 time 231364252682 state 0x1 ref 1 00000100:00100000:3.0:1789762928.977088:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231414252682 time 231414319673 state 0x0 ref 1 00000100:00100000:3.0:1789762928.977108:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612096:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762928.977155:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 25165824, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xc000 00010000:00010000:3.0:1789762928.977163:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.977176:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:3.0:1789762928.977180:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762928.977184:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.977195:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762928.982324:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967557 is committed 00002000:00010000:3.0:1789762928.982394:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:3.0:1789762928.982398:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 49152 -> 51200 00010000:00010000:3.0:1789762928.982407:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.982418:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.982441:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.982449:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762928.982454:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.982464:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.982478:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762928.982484:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aca4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762928.982533:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612096:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5431us (48672us total) trans 4294967557 rc 0/0 00000100:00100000:3.0:1789762928.982541:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:3.0:1789762928.982550:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231414252682 time 231414319673 state 0x2 ref 0 00000100:00100000:0.0:1789762928.984861:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762928.984906:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612224 00000100:00100000:1.0:1789762928.984914:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612224 00000100:00100000:1.0:1789762928.984950:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231414252682 time 231414319673 state 0x0 ref 1 00000100:00100000:1.0:1789762928.984960:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231464319673 time 231414319673 state 0x1 ref 1 00000100:00100000:3.0:1789762929.027181:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231464319673 time 231464416873 state 0x0 ref 1 00000100:00100000:3.0:1789762929.027214:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246612224:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:0.0:1789762929.027240:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762929.027276:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 26214400, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xc800 00010000:00010000:3.0:1789762929.027283:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.027295:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:3.0:1789762929.027298:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762929.027303:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.027314:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.032745:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967558 is committed 00002000:00010000:3.0:1789762929.032834:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:3.0:1789762929.032839:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 51200 -> 53248 00010000:00010000:3.0:1789762929.032859:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.032867:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.032874:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.032879:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.032883:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.032899:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.032923:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.032929:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acab lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.032980:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246612224:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5780us (48120us total) trans 4294967558 rc 0/0 00000100:00100000:3.0:1789762929.032986:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:3.0:1789762929.032994:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231464319673 time 231464416873 state 0x2 ref 0 00000100:00100000:1.0:1789762929.035177:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.035212:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612352 00000100:00100000:3.0:1789762929.035219:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612352 00000100:00100000:3.0:1789762929.035252:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231464319673 time 231464416873 state 0x0 ref 1 00000100:00100000:3.0:1789762929.035262:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231514416873 time 231464416873 state 0x1 ref 1 00000100:00100000:1.0:1789762929.077282:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231514416873 time 231514517428 state 0x0 ref 1 00000100:00100000:1.0:1789762929.077301:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612352:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.077338:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 27262976, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xd000 00010000:00010000:1.0:1789762929.077345:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.077366:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762929.077369:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.077374:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.077384:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.082023:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967559 is committed 00002000:00010000:1.0:1789762929.082087:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:1.0:1789762929.082091:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 53248 -> 55296 00010000:00010000:1.0:1789762929.082099:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.082107:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.082114:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.082118:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762929.082122:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.082128:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.082150:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.082156:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762929.082203:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612352:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4908us (47027us total) trans 4294967559 rc 0/0 00000100:00100000:1.0:1789762929.082210:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:1.0:1789762929.082217:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231514416873 time 231514517428 state 0x2 ref 0 00000100:00100000:2.0:1789762929.084256:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.084303:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612480 00000100:00100000:3.0:1789762929.084312:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612480 00000100:00100000:3.0:1789762929.084353:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231514416873 time 231514517428 state 0x0 ref 1 00000100:00100000:3.0:1789762929.084368:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231564517428 time 231514517428 state 0x1 ref 1 00000100:00100000:3.0:1789762929.127339:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231564517428 time 231564570979 state 0x0 ref 1 00000100:00100000:3.0:1789762929.127370:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246612480:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762929.127415:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 28311552, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xd800 00010000:00010000:3.0:1789762929.127422:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.127437:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:3.0:1789762929.127440:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762929.127445:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.127466:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.132602:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967560 is committed 00002000:00010000:3.0:1789762929.132668:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:3.0:1789762929.132673:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 55296 -> 57344 00010000:00010000:3.0:1789762929.132694:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.132703:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.132709:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.132736:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.132740:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.132746:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.132776:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.132782:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.132834:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246612480:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5480us (48577us total) trans 4294967560 rc 0/0 00000100:00100000:3.0:1789762929.132841:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:3.0:1789762929.132849:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231564517428 time 231564570979 state 0x2 ref 0 00000100:00100000:0.0:1789762929.134927:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.134966:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612608 00000100:00100000:3.0:1789762929.134973:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612608 00000100:00100000:3.0:1789762929.135008:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231564517428 time 231564570979 state 0x0 ref 1 00000100:00100000:3.0:1789762929.135018:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231614570979 time 231564570979 state 0x1 ref 1 00000100:00100000:1.0:1789762929.177410:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231614570979 time 231614641742 state 0x0 ref 1 00000100:00100000:1.0:1789762929.177432:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612608:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.177489:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 29360128, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xe000 00010000:00010000:1.0:1789762929.177500:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.177514:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762929.177518:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.177522:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.177534:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.182830:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967561 is committed 00002000:00010000:1.0:1789762929.182913:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:1.0:1789762929.182919:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 57344 -> 59392 00010000:00010000:1.0:1789762929.182928:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.182937:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.182944:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.182949:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762929.182952:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.182959:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.182972:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.182977:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762929.183043:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612608:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5616us (48114us total) trans 4294967561 rc 0/0 00000100:00100000:1.0:1789762929.183061:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:1.0:1789762929.183084:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231614570979 time 231614641742 state 0x2 ref 0 00000100:00100000:2.0:1789762929.185368:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762929.185442:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612736 00000100:00100000:1.0:1789762929.185450:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612736 00000100:00100000:1.0:1789762929.185485:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231614570979 time 231614641742 state 0x0 ref 1 00000100:00100000:1.0:1789762929.185496:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231664641742 time 231614641742 state 0x1 ref 1 00000100:00100000:1.0:1789762929.227468:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231664641742 time 231664699824 state 0x0 ref 1 00000100:00100000:1.0:1789762929.227488:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612736:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.227533:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 30408704, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xe800 00010000:00010000:1.0:1789762929.227541:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.227554:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762929.227558:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.227563:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.227574:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.232422:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967562 is committed 00002000:00010000:3.0:1789762929.232503:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:3.0:1789762929.232513:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 59392 -> 61440 00010000:00010000:3.0:1789762929.232523:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.232532:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.232538:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.232543:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.232546:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.232553:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.232566:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.232572:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5acc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.232628:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612736:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5146us (47260us total) trans 4294967562 rc 0/0 00000100:00100000:3.0:1789762929.232635:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1789762929.232643:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231664641742 time 231664699824 state 0x2 ref 0 00000100:00100000:0.0:1789762929.234939:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.234974:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612864 00000100:00100000:3.0:1789762929.234981:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612864 00000100:00100000:3.0:1789762929.235015:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231664641742 time 231664699824 state 0x0 ref 1 00000100:00100000:3.0:1789762929.235026:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231714699824 time 231664699824 state 0x1 ref 1 00000100:00100000:2.0:1789762929.277529:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231714699824 time 231714761782 state 0x0 ref 1 00000100:00100000:2.0:1789762929.277550:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246612864:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762929.277597:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 31457280, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xf000 00010000:00010000:2.0:1789762929.277605:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.277618:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:2.0:1789762929.277622:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762929.277626:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.277637:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.282721:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967563 is committed 00002000:00010000:3.0:1789762929.282791:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:3.0:1789762929.282797:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 61440 -> 63488 00010000:00010000:3.0:1789762929.282805:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.282814:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.282821:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.282826:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.282829:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.282837:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.282850:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.282865:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5acce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.282927:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246612864:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5382us (47987us total) trans 4294967563 rc 0/0 00000100:00100000:3.0:1789762929.282937:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:3.0:1789762929.282947:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231714699824 time 231714761782 state 0x2 ref 0 00000100:00100000:2.0:1789762929.285348:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762929.285416:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246612992 00000100:00100000:1.0:1789762929.285432:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246612992 00000100:00100000:1.0:1789762929.285478:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231714699824 time 231714761782 state 0x0 ref 1 00000100:00100000:1.0:1789762929.285494:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231764761782 time 231714761782 state 0x1 ref 1 00000100:00100000:3.0:1789762929.327662:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231764761782 time 231764888776 state 0x0 ref 1 00000100:00100000:3.0:1789762929.327700:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612992:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762929.327781:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 32505856, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0xf800 00010000:00010000:3.0:1789762929.327790:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.327804:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:3.0:1789762929.327808:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762929.327812:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.327824:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.333064:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967564 is committed 00002000:00010000:3.0:1789762929.333149:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:3.0:1789762929.333160:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 63488 -> 65536 00010000:00010000:3.0:1789762929.333169:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.333178:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.333184:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.333190:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.333195:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.333205:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.333225:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.333233:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5acd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.333301:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246612992:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5622us (47953us total) trans 4294967564 rc 0/0 00000100:00100000:3.0:1789762929.333311:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:3.0:1789762929.333323:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231764761782 time 231764888776 state 0x2 ref 0 00000100:00100000:0.0:1789762929.335746:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.335798:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246613120 00000100:00100000:3.0:1789762929.335806:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246613120 00000100:00100000:3.0:1789762929.335842:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231764761782 time 231764888776 state 0x0 ref 1 00000100:00100000:3.0:1789762929.335853:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231814888776 time 231764888776 state 0x1 ref 1 00000100:00100000:0.0:1789762929.377745:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231814888776 time 231814976147 state 0x0 ref 1 00000100:00100000:0.0:1789762929.377791:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613120:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762929.377836:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 33554432, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x10000 00010000:00010000:0.0:1789762929.377844:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762929.377857:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:0.0:1789762929.377861:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762929.377865:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762929.377877:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.382975:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967565 is committed 00002000:00010000:3.0:1789762929.383054:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:3.0:1789762929.383059:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 65536 -> 67584 00010000:00010000:3.0:1789762929.383069:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.383078:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.383084:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.383089:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c5c35a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.383092:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.383099:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.383112:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.383128:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a255ec02/0x5915dfb1c1b5acdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.383186:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613120:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5402us (47440us total) trans 4294967565 rc 0/0 00000100:00100000:3.0:1789762929.383194:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:3.0:1789762929.383203:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231814888776 time 231814976147 state 0x2 ref 0 00000100:00100000:1.0:1789762929.385443:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.385478:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246613248 00000100:00100000:3.0:1789762929.385486:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246613248 00000100:00100000:3.0:1789762929.385520:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231814888776 time 231814976147 state 0x0 ref 1 00000100:00100000:3.0:1789762929.385531:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231864976147 time 231814976147 state 0x1 ref 1 00000100:00100000:3.0:1789762929.427805:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231864976147 time 231865037439 state 0x0 ref 1 00000100:00100000:3.0:1789762929.427826:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613248:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762929.427871:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 34603008, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x10800 00010000:00010000:3.0:1789762929.427879:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.427896:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:3.0:1789762929.427900:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762929.427921:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.427937:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.433055:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967566 is committed 00002000:00010000:3.0:1789762929.433140:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:3.0:1789762929.433144:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 67584 -> 69632 00010000:00010000:3.0:1789762929.433153:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.433160:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.433166:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.433172:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.433175:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.433182:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.433195:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.433215:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ace3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.433275:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613248:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5454us (47832us total) trans 4294967566 rc 0/0 00000100:00100000:3.0:1789762929.433284:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:3.0:1789762929.433293:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231864976147 time 231865037439 state 0x2 ref 0 00000100:00100000:0.0:1789762929.435809:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.435843:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246613376 00000100:00100000:3.0:1789762929.435860:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246613376 00000100:00100000:3.0:1789762929.435898:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231864976147 time 231865037439 state 0x0 ref 1 00000100:00100000:3.0:1789762929.435913:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231915037439 time 231865037439 state 0x1 ref 1 00000100:00100000:1.0:1789762929.477895:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231915037439 time 231915128300 state 0x0 ref 1 00000100:00100000:1.0:1789762929.477916:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2356:x1876702246613376:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.477969:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 35651584, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x11000 00010000:00010000:1.0:1789762929.477979:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.477995:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762929.478001:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.478008:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.478032:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.483207:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967567 is committed 00002000:00010000:1.0:1789762929.483289:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:1.0:1789762929.483294:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 69632 -> 71680 00010000:00010000:1.0:1789762929.483303:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.483327:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.483337:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.483346:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762929.483351:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.483371:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.483386:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.483392:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762929.483456:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2356:x1876702246613376:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5546us (47648us total) trans 4294967567 rc 0/0 00000100:00100000:1.0:1789762929.483463:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:1.0:1789762929.483471:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231915037439 time 231915128300 state 0x2 ref 0 00000100:00100000:0.0:1789762929.485900:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.485936:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246613504 00000100:00100000:3.0:1789762929.485945:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246613504 00000100:00100000:3.0:1789762929.485981:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231915037439 time 231915128300 state 0x0 ref 1 00000100:00100000:3.0:1789762929.485992:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231965128300 time 231915128300 state 0x1 ref 1 00000100:00100000:1.0:1789762929.527995:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231965128300 time 231965223279 state 0x0 ref 1 00000100:00100000:1.0:1789762929.528028:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613504:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.528074:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 36700160, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x11800 00010000:00010000:1.0:1789762929.528082:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.528096:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=231s v=(0 0) 00010000:00010000:1.0:1789762929.528101:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.528108:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.528124:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.530947:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789762929.532883:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967568 is committed 00002000:00010000:1.0:1789762929.532951:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:1.0:1789762929.532957:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 71680 -> 73728 00010000:00010000:1.0:1789762929.532967:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.532979:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.532990:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.532999:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762929.533010:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.533018:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.533032:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.533037:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762929.533089:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613504:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5066us (47190us total) trans 4294967568 rc 0/0 00000100:00100000:1.0:1789762929.533098:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1789762929.533109:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231965128300 time 231965223279 state 0x2 ref 0 00000100:00100000:2.0:1789762929.535387:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.535436:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246613632 00000100:00100000:3.0:1789762929.535445:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246613632 00000100:00100000:3.0:1789762929.535489:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 231965128300 time 231965223279 state 0x0 ref 1 00000100:00100000:3.0:1789762929.535514:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232015223279 time 231965223279 state 0x1 ref 1 00000100:00100000:1.0:1789762929.578078:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232015223279 time 232015310004 state 0x0 ref 1 00000100:00100000:1.0:1789762929.578101:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246613632:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.578160:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 37748736, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x12000 00010000:00010000:1.0:1789762929.578167:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.578180:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762929.578193:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.578198:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.578211:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.582856:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967569 is committed 00002000:00010000:3.0:1789762929.582932:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:3.0:1789762929.582937:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 73728 -> 75776 00010000:00010000:3.0:1789762929.582945:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.582953:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.582960:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.582964:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.582968:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.582974:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.582987:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.582992:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5acf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.583055:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246613632:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4962us (47668us total) trans 4294967569 rc 0/0 00000100:00100000:3.0:1789762929.583062:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:3.0:1789762929.583072:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232015223279 time 232015310004 state 0x2 ref 0 00000100:00100000:0.0:1789762929.585201:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762929.585247:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246613760 00000100:00100000:1.0:1789762929.585256:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246613760 00000100:00100000:1.0:1789762929.585296:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232015223279 time 232015310004 state 0x0 ref 1 00000100:00100000:1.0:1789762929.585308:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232065310004 time 232015310004 state 0x1 ref 1 00000100:00100000:2.0:1789762929.628162:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232065310004 time 232065393461 state 0x0 ref 1 00000100:00100000:2.0:1789762929.628183:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613760:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762929.628237:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 38797312, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x12800 00010000:00010000:2.0:1789762929.628245:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.628258:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1789762929.628261:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762929.628266:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.628276:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.633254:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967570 is committed 00002000:00010000:3.0:1789762929.633355:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:3.0:1789762929.633361:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 75776 -> 77824 00010000:00010000:3.0:1789762929.633368:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.633377:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.633383:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.633388:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.633392:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.633398:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.633410:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.633426:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5acff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.633478:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246613760:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5303us (48277us total) trans 4294967570 rc 0/0 00000100:00100000:3.0:1789762929.633484:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:3.0:1789762929.633491:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232065310004 time 232065393461 state 0x2 ref 0 00000100:00100000:1.0:1789762929.635606:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.635641:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246613888 00000100:00100000:3.0:1789762929.635648:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246613888 00000100:00100000:3.0:1789762929.635690:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232065310004 time 232065393461 state 0x0 ref 1 00000100:00100000:3.0:1789762929.635701:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232115393461 time 232065393461 state 0x1 ref 1 00000100:00100000:2.0:1789762929.678262:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232115393461 time 232115499842 state 0x0 ref 1 00000100:00100000:2.0:1789762929.678279:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246613888:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762929.678313:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 39845888, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x13000 00010000:00010000:2.0:1789762929.678319:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.678337:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1789762929.678340:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762929.678344:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.678354:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762929.682854:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967571 is committed 00002000:00010000:2.0:1789762929.682955:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:2.0:1789762929.682960:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 77824 -> 79872 00010000:00010000:2.0:1789762929.682967:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.682975:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.682982:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.682986:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762929.682989:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.682996:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.683018:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.683024:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762929.683071:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246613888:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4797us (47466us total) trans 4294967571 rc 0/0 00000100:00100000:2.0:1789762929.683078:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:2.0:1789762929.683085:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232115393461 time 232115499842 state 0x2 ref 0 00000100:00100000:1.0:1789762929.684941:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.684986:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614016 00000100:00100000:3.0:1789762929.684993:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614016 00000100:00100000:3.0:1789762929.685023:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232115393461 time 232115499842 state 0x0 ref 1 00000100:00100000:3.0:1789762929.685032:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232165499842 time 232115499842 state 0x1 ref 1 00000100:00100000:3.0:1789762929.728319:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232165499842 time 232165556435 state 0x0 ref 1 00000100:00100000:3.0:1789762929.728336:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614016:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762929.728376:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 40894464, mtime: 0x6aad9d71, atime: 0x0, ctime: 0x6aad9d71, blocks: 0x13800 00010000:00010000:3.0:1789762929.728382:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.728393:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:3.0:1789762929.728397:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762929.728401:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.728410:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.733122:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967572 is committed 00002000:00010000:3.0:1789762929.733216:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:3.0:1789762929.733221:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 1789762929 -> 1789762930 00002000:00010000:3.0:1789762929.733223:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 1789762929 -> 1789762930 00002000:00010000:3.0:1789762929.733224:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 79872 -> 81920 00010000:00010000:3.0:1789762929.733232:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.733240:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.733246:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.733251:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.733260:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.733267:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.733278:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.733284:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.733332:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614016:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5000us (48392us total) trans 4294967572 rc 0/0 00000100:00100000:3.0:1789762929.733339:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:3.0:1789762929.733347:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232165499842 time 232165556435 state 0x2 ref 0 00000100:00100000:1.0:1789762929.735238:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.735270:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614144 00000100:00100000:3.0:1789762929.735277:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614144 00000100:00100000:3.0:1789762929.735307:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232165499842 time 232165556435 state 0x0 ref 1 00000100:00100000:3.0:1789762929.735317:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232215556435 time 232165556435 state 0x1 ref 1 00000100:00100000:1.0:1789762929.778482:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232215556435 time 232215707349 state 0x0 ref 1 00000100:00100000:1.0:1789762929.778512:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614144:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.778573:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 41943040, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x14000 00010000:00010000:1.0:1789762929.778584:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.778604:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762929.778610:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.778629:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.778671:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.785906:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967573 is committed 00002000:00010000:3.0:1789762929.786007:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789762929.786012:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 81920 -> 83968 00010000:00010000:3.0:1789762929.786021:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.786037:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.786044:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.786049:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.786052:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.786058:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.786071:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.786077:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.786130:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614144:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7628us (50892us total) trans 4294967573 rc 0/0 00000100:00100000:3.0:1789762929.786138:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:3.0:1789762929.786146:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232215556435 time 232215707349 state 0x2 ref 0 00000100:00100000:1.0:1789762929.788726:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762929.788774:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614272 00000100:00100000:2.0:1789762929.788782:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614272 00000100:00100000:2.0:1789762929.788819:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232215556435 time 232215707349 state 0x0 ref 1 00000100:00100000:2.0:1789762929.788829:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232265707349 time 232215707349 state 0x1 ref 1 00000100:00100000:1.0:1789762929.828708:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232265707349 time 232265941225 state 0x0 ref 1 00000100:00100000:1.0:1789762929.828732:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614272:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.828853:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 42991616, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x14800 00010000:00010000:1.0:1789762929.828861:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.828874:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762929.828878:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.828883:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.828893:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.834866:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967574 is committed 00002000:00010000:1.0:1789762929.834944:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:1.0:1789762929.834949:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 83968 -> 86016 00010000:00010000:1.0:1789762929.834958:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.834977:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.834983:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.835005:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762929.835009:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.835019:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.835035:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.835042:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762929.835122:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614272:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6399us (46396us total) trans 4294967574 rc 0/0 00000100:00100000:1.0:1789762929.835130:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:1.0:1789762929.835138:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232265707349 time 232265941225 state 0x2 ref 0 00000100:00100000:1.0:1789762929.837695:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.837742:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614400 00000100:00100000:3.0:1789762929.837792:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614400 00000100:00100000:3.0:1789762929.837834:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232265707349 time 232265941225 state 0x0 ref 1 00000100:00100000:3.0:1789762929.837847:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232315941225 time 232265941225 state 0x1 ref 1 00000100:00100000:1.0:1789762929.878828:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232315941225 time 232316056626 state 0x0 ref 1 00000100:00100000:1.0:1789762929.878854:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614400:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762929.878909:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 44040192, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x15000 00010000:00010000:1.0:1789762929.878918:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.878935:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762929.878939:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762929.878945:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762929.878969:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.885632:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967575 is committed 00002000:00010000:3.0:1789762929.885797:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:3.0:1789762929.885803:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 86016 -> 88064 00010000:00010000:3.0:1789762929.885814:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.885824:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.885833:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.885839:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.885843:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.885852:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.885867:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.885873:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.885947:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614400:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7100us (48251us total) trans 4294967575 rc 0/0 00000100:00100000:3.0:1789762929.885956:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:3.0:1789762929.885966:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232315941225 time 232316056626 state 0x2 ref 0 00000100:00100000:1.0:1789762929.888399:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.888445:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614528 00000100:00100000:3.0:1789762929.888455:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614528 00000100:00100000:3.0:1789762929.888501:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232315941225 time 232316056626 state 0x0 ref 1 00000100:00100000:3.0:1789762929.888518:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232366056626 time 232316056626 state 0x1 ref 1 00000100:00100000:3.0:1789762929.928881:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232366056626 time 232366115406 state 0x0 ref 1 00000100:00100000:3.0:1789762929.928899:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614528:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762929.928988:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 45088768, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x15800 00010000:00010000:3.0:1789762929.928995:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.929007:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:3.0:1789762929.929010:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762929.929014:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.929024:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.933834:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967576 is committed 00002000:00010000:3.0:1789762929.933936:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:3.0:1789762929.933941:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 88064 -> 90112 00010000:00010000:3.0:1789762929.933948:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.933957:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.933963:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.933968:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.933971:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.933977:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.933989:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.933993:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.934043:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614528:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5148us (45644us total) trans 4294967576 rc 0/0 00000100:00100000:3.0:1789762929.934057:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:3.0:1789762929.934064:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232366056626 time 232366115406 state 0x2 ref 0 00000100:00100000:0.0:1789762929.936143:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762929.936223:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614656 00000100:00100000:1.0:1789762929.936231:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614656 00000100:00100000:1.0:1789762929.936266:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232366056626 time 232366115406 state 0x0 ref 1 00000100:00100000:1.0:1789762929.936275:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232416115406 time 232366115406 state 0x1 ref 1 00000100:00100000:2.0:1789762929.978993:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232416115406 time 232416224649 state 0x0 ref 1 00000100:00100000:2.0:1789762929.979014:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614656:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762929.979069:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 46137344, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x16000 00010000:00010000:2.0:1789762929.979076:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.979089:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1789762929.979093:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762929.979097:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762929.979108:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762929.984489:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967577 is committed 00002000:00010000:3.0:1789762929.984588:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:3.0:1789762929.984593:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 90112 -> 92160 00010000:00010000:3.0:1789762929.984602:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.984611:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.984617:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.984622:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762929.984625:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.984632:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.984645:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762929.984649:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68f4dfa/0x5915dfb1c1b5ad30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762929.984728:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614656:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5719us (48585us total) trans 4294967577 rc 0/0 00000100:00100000:3.0:1789762929.984735:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:3.0:1789762929.984742:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232416115406 time 232416224649 state 0x2 ref 0 00000100:00100000:1.0:1789762929.986899:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762929.986936:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614784 00000100:00100000:3.0:1789762929.986943:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614784 00000100:00100000:3.0:1789762929.986976:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232416115406 time 232416224649 state 0x0 ref 1 00000100:00100000:3.0:1789762929.986986:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232466224649 time 232416224649 state 0x1 ref 1 00000100:00100000:2.0:1789762930.029051:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232466224649 time 232466288148 state 0x0 ref 1 00000100:00100000:2.0:1789762930.029067:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614784:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762930.029099:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 47185920, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x16800 00010000:00010000:2.0:1789762930.029112:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.029123:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1789762930.029127:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762930.029130:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.029140:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762930.033631:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967578 is committed 00002000:00010000:2.0:1789762930.033738:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:2.0:1789762930.033743:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 92160 -> 94208 00010000:00010000:2.0:1789762930.033766:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.033775:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.033781:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.033786:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762930.033789:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.033795:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.033805:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.033810:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5ad37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762930.033855:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246614784:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4791us (46957us total) trans 4294967578 rc 0/0 00000100:00100000:2.0:1789762930.033869:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:2.0:1789762930.033876:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232466224649 time 232466288148 state 0x2 ref 0 00000100:00100000:1.0:1789762930.035776:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.035815:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246614912 00000100:00100000:3.0:1789762930.035822:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246614912 00000100:00100000:3.0:1789762930.035852:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232466224649 time 232466288148 state 0x0 ref 1 00000100:00100000:3.0:1789762930.035861:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232516288148 time 232466288148 state 0x1 ref 1 00000100:00100000:3.0:1789762930.079114:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232516288148 time 232516348084 state 0x0 ref 1 00000100:00100000:3.0:1789762930.079134:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614912:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762930.079183:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 48234496, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x17000 00010000:00010000:3.0:1789762930.079191:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.079213:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:3.0:1789762930.079216:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762930.079221:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.079246:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.084780:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967579 is committed 00002000:00010000:3.0:1789762930.084848:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789762930.084853:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 94208 -> 96256 00010000:00010000:3.0:1789762930.084862:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.084870:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.084876:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.084881:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.084884:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.084892:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.084913:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.084918:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.084969:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246614912:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5841us (49194us total) trans 4294967579 rc 0/0 00000100:00100000:3.0:1789762930.084975:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:3.0:1789762930.084983:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232516288148 time 232516348084 state 0x2 ref 0 00000100:00100000:0.0:1789762930.087238:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.087280:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615040 00000100:00100000:3.0:1789762930.087290:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615040 00000100:00100000:3.0:1789762930.087324:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232516288148 time 232516348084 state 0x0 ref 1 00000100:00100000:3.0:1789762930.087335:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232566348084 time 232516348084 state 0x1 ref 1 00000100:00100000:1.0:1789762930.129209:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232566348084 time 232566445328 state 0x0 ref 1 00000100:00100000:1.0:1789762930.129237:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615040:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.129272:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 49283072, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x17800 00010000:00010000:1.0:1789762930.129279:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.129291:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762930.129294:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.129299:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.129309:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.134105:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967580 is committed 00002000:00010000:3.0:1789762930.134182:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:3.0:1789762930.134187:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 96256 -> 98304 00010000:00010000:3.0:1789762930.134194:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.134203:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.134220:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.134225:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.134228:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.134234:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.134257:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.134262:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5ad45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.134310:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615040:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5076us (47073us total) trans 4294967580 rc 0/0 00000100:00100000:3.0:1789762930.134316:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:3.0:1789762930.134323:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232566348084 time 232566445328 state 0x2 ref 0 00000100:00100000:0.0:1789762930.136506:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762930.136592:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615168 00000100:00100000:2.0:1789762930.136599:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615168 00000100:00100000:2.0:1789762930.136634:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232566348084 time 232566445328 state 0x0 ref 1 00000100:00100000:2.0:1789762930.136644:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232616445328 time 232566445328 state 0x1 ref 1 00000100:00100000:1.0:1789762930.179312:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232616445328 time 232616545454 state 0x0 ref 1 00000100:00100000:1.0:1789762930.179331:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615168:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.179382:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 50331648, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x18000 00010000:00010000:1.0:1789762930.179390:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.179402:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762930.179406:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.179410:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.179444:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762930.184918:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967581 is committed 00002000:00010000:2.0:1789762930.185025:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:2.0:1789762930.185030:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 98304 -> 100352 00010000:00010000:2.0:1789762930.185038:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.185047:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.185054:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.185058:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762930.185061:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.185079:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.185091:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.185097:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2de00a/0x5915dfb1c1b5ad4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762930.185148:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615168:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5823us (48644us total) trans 4294967581 rc 0/0 00000100:00100000:2.0:1789762930.185155:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:2.0:1789762930.185162:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232616445328 time 232616545454 state 0x2 ref 0 00000100:00100000:0.0:1789762930.187381:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.187425:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615296 00000100:00100000:3.0:1789762930.187434:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615296 00000100:00100000:3.0:1789762930.187469:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232616445328 time 232616545454 state 0x0 ref 1 00000100:00100000:3.0:1789762930.187485:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232666545454 time 232616545454 state 0x1 ref 1 00000100:00100000:1.0:1789762930.229453:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232666545454 time 232666670037 state 0x0 ref 1 00000100:00100000:1.0:1789762930.229479:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615296:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.229535:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 51380224, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x18800 00010000:00010000:1.0:1789762930.229545:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.229562:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762930.229566:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.229573:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.229587:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762930.235652:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967582 is committed 00002000:00010000:1.0:1789762930.235786:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:1.0:1789762930.235791:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 100352 -> 102400 00010000:00010000:1.0:1789762930.235801:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.235811:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.235824:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.235829:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762930.235833:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.235840:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.235855:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.235861:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762930.235930:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615296:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6459us (48548us total) trans 4294967582 rc 0/0 00000100:00100000:1.0:1789762930.235937:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1789762930.235946:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232666545454 time 232666670037 state 0x2 ref 0 00000100:00100000:0.0:1789762930.238470:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.238522:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615424 00000100:00100000:3.0:1789762930.238530:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615424 00000100:00100000:3.0:1789762930.238568:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232666545454 time 232666670037 state 0x0 ref 1 00000100:00100000:3.0:1789762930.238579:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232716670037 time 232666670037 state 0x1 ref 1 00000100:00100000:3.0:1789762930.279498:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232716670037 time 232716726209 state 0x0 ref 1 00000100:00100000:3.0:1789762930.279524:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615424:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762930.279572:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 52428800, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x19000 00010000:00010000:3.0:1789762930.279578:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.279591:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:3.0:1789762930.279595:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762930.279600:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.279611:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.285472:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967583 is committed 00002000:00010000:3.0:1789762930.285541:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:3.0:1789762930.285546:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 102400 -> 104448 00010000:00010000:3.0:1789762930.285555:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.285564:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.285570:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.285575:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.285579:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.285586:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.285599:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.285604:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.285659:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615424:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6144us (47190us total) trans 4294967583 rc 0/0 00000100:00100000:3.0:1789762930.285682:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:3.0:1789762930.285693:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232716670037 time 232716726209 state 0x2 ref 0 00000100:00100000:2.0:1789762930.287870:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762930.287917:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615552 00000100:00100000:1.0:1789762930.287924:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615552 00000100:00100000:1.0:1789762930.287961:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232716670037 time 232716726209 state 0x0 ref 1 00000100:00100000:1.0:1789762930.287981:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232766726209 time 232716726209 state 0x1 ref 1 00000100:00100000:2.0:1789762930.329592:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232766726209 time 232766827513 state 0x0 ref 1 00000100:00100000:2.0:1789762930.329609:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615552:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762930.329641:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 53477376, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x19800 00010000:00010000:2.0:1789762930.329647:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.329658:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1789762930.329668:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762930.329688:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.329704:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.334523:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967584 is committed 00002000:00010000:3.0:1789762930.334596:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:3.0:1789762930.334600:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 104448 -> 106496 00010000:00010000:3.0:1789762930.334608:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.334616:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.334623:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.334627:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.334631:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.334637:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.334648:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.334653:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.334722:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615552:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5118us (46852us total) trans 4294967584 rc 0/0 00000100:00100000:3.0:1789762930.334738:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:3.0:1789762930.334745:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232766726209 time 232766827513 state 0x2 ref 0 00000100:00100000:0.0:1789762930.336873:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762930.336926:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615680 00000100:00100000:1.0:1789762930.336933:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615680 00000100:00100000:1.0:1789762930.336966:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232766726209 time 232766827513 state 0x0 ref 1 00000100:00100000:1.0:1789762930.336976:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232816827513 time 232766827513 state 0x1 ref 1 00000100:00100000:2.0:1789762930.379744:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232816827513 time 232816977028 state 0x0 ref 1 00000100:00100000:2.0:1789762930.379797:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615680:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762930.379836:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 54525952, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1a000 00010000:00010000:2.0:1789762930.379843:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.379853:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1789762930.379857:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762930.379861:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.379871:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.384778:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967585 is committed 00002000:00010000:3.0:1789762930.384847:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:3.0:1789762930.384853:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 106496 -> 108544 00010000:00010000:3.0:1789762930.384864:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.384876:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.384886:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.384894:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.384898:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.384907:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.384919:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.384934:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077d8715a/0x5915dfb1c1b5ad68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.384984:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615680:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5196us (48112us total) trans 4294967585 rc 0/0 00000100:00100000:3.0:1789762930.384990:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:3.0:1789762930.384996:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232816827513 time 232816977028 state 0x2 ref 0 00000100:00100000:0.0:1789762930.386986:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.387020:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615808 00000100:00100000:3.0:1789762930.387027:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615808 00000100:00100000:3.0:1789762930.387057:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232816827513 time 232816977028 state 0x0 ref 1 00000100:00100000:3.0:1789762930.387067:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232866977028 time 232816977028 state 0x1 ref 1 00000100:00100000:3.0:1789762930.429807:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232866977028 time 232867040040 state 0x0 ref 1 00000100:00100000:3.0:1789762930.429828:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615808:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762930.429875:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 55574528, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1a800 00010000:00010000:3.0:1789762930.429882:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.429895:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:3.0:1789762930.429899:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762930.429916:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.429927:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.434961:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967586 is committed 00002000:00010000:3.0:1789762930.435036:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:3.0:1789762930.435041:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 108544 -> 110592 00010000:00010000:3.0:1789762930.435049:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.435058:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.435064:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.435069:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.435073:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.435080:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.435093:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.435108:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ad6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.435166:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246615808:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5341us (48177us total) trans 4294967586 rc 0/0 00000100:00100000:3.0:1789762930.435177:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:3.0:1789762930.435190:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232866977028 time 232867040040 state 0x2 ref 0 00000100:00100000:2.0:1789762930.437342:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.437383:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246615936 00000100:00100000:3.0:1789762930.437392:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246615936 00000100:00100000:3.0:1789762930.437436:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232866977028 time 232867040040 state 0x0 ref 1 00000100:00100000:3.0:1789762930.437448:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232917040040 time 232867040040 state 0x1 ref 1 00000100:00100000:1.0:1789762930.479896:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232917040040 time 232917127224 state 0x0 ref 1 00000100:00100000:1.0:1789762930.479929:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615936:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.479976:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 56623104, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1b000 00010000:00010000:1.0:1789762930.479984:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.479997:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762930.480001:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.480006:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.480017:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.486275:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967587 is committed 00002000:00010000:3.0:1789762930.486368:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:3.0:1789762930.486374:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 110592 -> 112640 00010000:00010000:3.0:1789762930.486387:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.486399:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.486409:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.486432:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.486437:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.486459:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.486478:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.486486:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ae1ad0/0x5915dfb1c1b5ad76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.486566:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246615936:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6642us (49222us total) trans 4294967587 rc 0/0 00000100:00100000:3.0:1789762930.486587:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:3.0:1789762930.486599:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232917040040 time 232917127224 state 0x2 ref 0 00000100:00100000:0.0:1789762930.488999:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.489031:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616064 00000100:00100000:3.0:1789762930.489039:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616064 00000100:00100000:3.0:1789762930.489074:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232917040040 time 232917127224 state 0x0 ref 1 00000100:00100000:3.0:1789762930.489084:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232967127224 time 232917127224 state 0x1 ref 1 00000004:00080000:0.0:1789762930.490850:0:8698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 232928097032ns, next at 233928094744ns, rc = 0 00000100:00100000:2.0:1789762930.490851:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789762930.490870:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762930.490871:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c5e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254926080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762930.490884:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254926208:0@lo:400:kworker.0 00000100:00100000:1.0:1789762930.490928:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254926336:0@lo:400:kworker.0 00000100:00100000:2.0:1789762930.490932:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762930.490936:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762930.490957:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254926464:0@lo:400:kworker.0 00000100:00100000:1.0:1789762930.490998:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762930.491010:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254926592:0@lo:400:kworker.0 00000100:00100000:3.0:1789762930.491013:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926080 00000100:00100000:2.0:1789762930.491014:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254926720:0@lo:400:kworker.0 00000100:00100000:3.0:1789762930.491018:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926080 00000100:00100000:1.0:1789762930.491038:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254926848:0@lo:400:kworker.0 00000100:00100000:0.0:1789762930.491048:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762930.491058:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762930.491069:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789762930.491075:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762930.491081:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254926080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789762930.491115:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 34030144 pending 9510912 free 3914231808 avail 3682709504 00000100:00100000:0.0:1789762930.491122:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926208 00000100:00100000:0.0:1789762930.491127:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926208 00000100:00100000:1.0:1789762930.491144:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926336 00000100:00100000:2.0:1789762930.491151:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926720 00000100:00100000:1.0:1789762930.491152:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926336 00000100:00100000:3.0:1789762930.491158:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254926080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762930.491159:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926720 00000100:00100000:3.0:1789762930.491167:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789762930.491172:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789762930.491194:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254926208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762930.491207:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789762930.491213:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c5e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254926080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762930.491214:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789762930.491220:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254926336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762930.491230:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254926720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762930.491243:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254926208:12345-0@lo:400:kworker.0 Request processed in 60us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762930.491254:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789762930.491273:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254926336:12345-0@lo:400:kworker.0 Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762930.491280:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789762930.491286:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254926720:12345-0@lo:400:kworker.0 Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762930.491294:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789762930.491309:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926592 00000100:00100000:1.0:1789762930.491313:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926592 00000100:00100000:3.0:1789762930.491315:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926848 00000100:00100000:3.0:1789762930.491321:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926848 00000100:00080000:2.0:1789762930.491327:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762930.491329:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254926208:0@lo:400:kworker.0 00000100:00080000:2.0:1789762930.491332:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789762930.491339:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762930.491365:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789762930.491373:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789762930.491388:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254926720:0@lo:400:kworker.0 00000100:00100000:1.0:1789762930.491392:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254926592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762930.491392:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254926848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762930.491401:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762930.491449:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254926592:12345-0@lo:400:kworker.0 Request processed in 62us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762930.491449:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926464 00000100:00100000:2.0:1789762930.491454:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926464 00000100:00100000:1.0:1789762930.491459:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789762930.491463:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254926592:0@lo:400:kworker.0 00000100:00100000:3.0:1789762930.491466:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254926848:12345-0@lo:400:kworker.0 Request processed in 87us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762930.491478:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789762930.491498:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789762930.491506:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762930.491514:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254926848:0@lo:400:kworker.0 00000100:00080000:3.0:1789762930.491514:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762930.491532:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254926336:0@lo:400:kworker.0 00000100:00100000:2.0:1789762930.491551:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254926464:12345-0@lo:400:kworker.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762930.491564:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789762930.491581:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254926464:0@lo:400:kworker.0 00000100:00100000:1.0:1789762930.530004:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232967127224 time 232967233643 state 0x0 ref 1 00000100:00100000:1.0:1789762930.530030:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616064:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.530078:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 57671680, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1b800 00010000:00010000:1.0:1789762930.530085:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.530118:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=232s v=(0 0) 00010000:00010000:1.0:1789762930.530122:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.530127:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.530139:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762930.535272:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967588 is committed 00002000:00010000:2.0:1789762930.535376:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:2.0:1789762930.535381:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 112640 -> 114688 00010000:00010000:2.0:1789762930.535391:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.535420:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.535427:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.535433:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762930.535439:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.535449:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.535479:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.535489:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ad7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762930.535558:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616064:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5536us (46558us total) trans 4294967588 rc 0/0 00000100:00100000:2.0:1789762930.535566:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:2.0:1789762930.535574:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232967127224 time 232967233643 state 0x2 ref 0 00000100:00100000:0.0:1789762930.537779:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.537824:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616192 00000100:00100000:3.0:1789762930.537832:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616192 00000100:00100000:3.0:1789762930.537866:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 232967127224 time 232967233643 state 0x0 ref 1 00000100:00100000:3.0:1789762930.537877:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233017233643 time 232967233643 state 0x1 ref 1 00010000:00010000:2.0:1789762930.554894:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762930.580081:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233017233643 time 233017316013 state 0x0 ref 1 00000100:00100000:1.0:1789762930.580105:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616192:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.580171:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 58720256, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1c000 00010000:00010000:1.0:1789762930.580192:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.580207:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:1.0:1789762930.580210:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.580215:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.580227:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.586281:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967589 is committed 00002000:00010000:3.0:1789762930.586361:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:3.0:1789762930.586366:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 114688 -> 116736 00010000:00010000:3.0:1789762930.586381:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.586390:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.586408:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.586413:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.586417:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.586424:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.586437:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.586441:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ad84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.586506:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616192:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6411us (48753us total) trans 4294967589 rc 0/0 00000100:00100000:3.0:1789762930.586514:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:3.0:1789762930.586523:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233017233643 time 233017316013 state 0x2 ref 0 00000100:00100000:0.0:1789762930.588690:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.588723:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616320 00000100:00100000:3.0:1789762930.588742:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616320 00000100:00100000:3.0:1789762930.588790:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233017233643 time 233017316013 state 0x0 ref 1 00000100:00100000:3.0:1789762930.588800:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233067316013 time 233017316013 state 0x1 ref 1 00000100:00100000:1.0:1789762930.630167:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233067316013 time 233067389392 state 0x0 ref 1 00000100:00100000:1.0:1789762930.630205:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616320:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.630249:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 59768832, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1c800 00010000:00010000:1.0:1789762930.630258:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.630274:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:1.0:1789762930.630280:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.630287:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.630303:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.635481:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967590 is committed 00002000:00010000:3.0:1789762930.635562:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:3.0:1789762930.635568:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 116736 -> 118784 00010000:00010000:3.0:1789762930.635593:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.635604:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.635611:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.635616:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.635620:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.635626:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.635641:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.635657:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008020df13/0x5915dfb1c1b5ad8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.635773:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616320:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5546us (47057us total) trans 4294967590 rc 0/0 00000100:00100000:3.0:1789762930.635783:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:3.0:1789762930.635793:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233067316013 time 233067389392 state 0x2 ref 0 00000100:00100000:0.0:1789762930.638151:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762930.638206:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616448 00000100:00100000:2.0:1789762930.638214:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616448 00000100:00100000:2.0:1789762930.638255:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233067316013 time 233067389392 state 0x0 ref 1 00000100:00100000:2.0:1789762930.638266:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233117389392 time 233067389392 state 0x1 ref 1 00000100:00100000:2.0:1789762930.680231:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233117389392 time 233117462981 state 0x0 ref 1 00000100:00100000:2.0:1789762930.680254:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616448:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762930.680300:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 60817408, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1d000 00010000:00010000:2.0:1789762930.680307:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.680320:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762930.680324:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762930.680328:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.680340:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762930.684497:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967591 is committed 00002000:00010000:2.0:1789762930.684589:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:2.0:1789762930.684594:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 118784 -> 120832 00010000:00010000:2.0:1789762930.684602:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.684617:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.684624:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.684630:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762930.684633:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.684639:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.684653:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.684658:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762930.684730:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616448:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4483us (46579us total) trans 4294967591 rc 0/0 00000100:00100000:2.0:1789762930.684737:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1789762930.684745:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233117389392 time 233117462981 state 0x2 ref 0 00000100:00100000:1.0:1789762930.687156:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.687197:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616576 00000100:00100000:3.0:1789762930.687205:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616576 00000100:00100000:3.0:1789762930.687241:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233117389392 time 233117462981 state 0x0 ref 1 00000100:00100000:3.0:1789762930.687251:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233167462981 time 233117462981 state 0x1 ref 1 00000100:00100000:2.0:1789762930.730308:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233167462981 time 233167541615 state 0x0 ref 1 00000100:00100000:2.0:1789762930.730337:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616576:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762930.730377:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 61865984, mtime: 0x6aad9d72, atime: 0x0, ctime: 0x6aad9d72, blocks: 0x1d800 00010000:00010000:2.0:1789762930.730383:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.730395:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762930.730399:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762930.730403:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.730414:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762930.734514:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967592 is committed 00002000:00010000:2.0:1789762930.734577:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:2.0:1789762930.734582:0:12138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 1789762930 -> 1789762931 00002000:00010000:2.0:1789762930.734585:0:12138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 1789762930 -> 1789762931 00002000:00010000:2.0:1789762930.734588:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 120832 -> 122880 00010000:00010000:2.0:1789762930.734599:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.734611:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.734621:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.734642:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762930.734647:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.734657:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.734687:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.734696:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5ad99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762930.734775:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616576:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4418us (47595us total) trans 4294967592 rc 0/0 00000100:00100000:2.0:1789762930.734784:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:2.0:1789762930.734791:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233167462981 time 233167541615 state 0x2 ref 0 00000100:00100000:1.0:1789762930.736865:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.736896:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616704 00000100:00100000:3.0:1789762930.736902:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616704 00000100:00100000:3.0:1789762930.736936:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233167462981 time 233167541615 state 0x0 ref 1 00000100:00100000:3.0:1789762930.736945:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233217541615 time 233167541615 state 0x1 ref 1 00000100:00100000:3.0:1789762930.780377:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233217541615 time 233217608184 state 0x0 ref 1 00000100:00100000:3.0:1789762930.780414:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616704:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762930.780460:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 62914560, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x1e000 00010000:00010000:3.0:1789762930.780467:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.780481:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:3.0:1789762930.780485:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762930.780489:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.780500:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.784918:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967593 is committed 00002000:00010000:3.0:1789762930.784993:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:3.0:1789762930.784999:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 122880 -> 124928 00010000:00010000:3.0:1789762930.785010:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.785019:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.785026:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.785031:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.785040:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.785047:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.785061:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.785067:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ada0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.785134:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616704:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4724us (48268us total) trans 4294967593 rc 0/0 00000100:00100000:3.0:1789762930.785142:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:3.0:1789762930.785151:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233217541615 time 233217608184 state 0x2 ref 0 00000100:00100000:0.0:1789762930.787397:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762930.787456:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616832 00000100:00100000:2.0:1789762930.787466:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616832 00000100:00100000:2.0:1789762930.787512:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233217541615 time 233217608184 state 0x0 ref 1 00000100:00100000:2.0:1789762930.787524:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233267608184 time 233217608184 state 0x1 ref 1 00000100:00100000:1.0:1789762930.830469:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233267608184 time 233267700349 state 0x0 ref 1 00000100:00100000:1.0:1789762930.830490:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616832:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762930.830534:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 63963136, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x1e800 00010000:00010000:1.0:1789762930.830542:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.830555:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:1.0:1789762930.830558:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762930.830573:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762930.830585:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.835027:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967594 is committed 00002000:00010000:3.0:1789762930.835089:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:3.0:1789762930.835096:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 124928 -> 126976 00010000:00010000:3.0:1789762930.835107:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.835117:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.835127:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.835150:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.835156:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.835165:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.835182:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.835191:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f3154d/0x5915dfb1c1b5ada7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.835261:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246616832:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4775us (47868us total) trans 4294967594 rc 0/0 00000100:00100000:3.0:1789762930.835272:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:3.0:1789762930.835281:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233267608184 time 233267700349 state 0x2 ref 0 00000100:00100000:0.0:1789762930.837402:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762930.837449:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246616960 00000100:00100000:2.0:1789762930.837457:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246616960 00000100:00100000:2.0:1789762930.837492:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233267608184 time 233267700349 state 0x0 ref 1 00000100:00100000:2.0:1789762930.837503:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233317700349 time 233267700349 state 0x1 ref 1 00000100:00100000:2.0:1789762930.880540:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233317700349 time 233317771784 state 0x0 ref 1 00000100:00100000:2.0:1789762930.880560:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616960:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762930.880604:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 65011712, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x1f000 00010000:00010000:2.0:1789762930.880611:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.880624:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762930.880628:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762930.880632:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.880643:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762930.884840:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967595 is committed 00002000:00010000:2.0:1789762930.884908:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:2.0:1789762930.884913:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 126976 -> 129024 00010000:00010000:2.0:1789762930.884920:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.884935:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.884942:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.884947:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762930.884950:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.884956:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.884969:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762930.884973:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adae lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762930.885023:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246616960:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4470us (47622us total) trans 4294967595 rc 0/0 00000100:00100000:2.0:1789762930.885029:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:2.0:1789762930.885037:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233317700349 time 233317771784 state 0x2 ref 0 00000100:00100000:1.0:1789762930.887200:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.887243:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617088 00000100:00100000:3.0:1789762930.887251:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617088 00000100:00100000:3.0:1789762930.887286:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233317700349 time 233317771784 state 0x0 ref 1 00000100:00100000:3.0:1789762930.887296:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233367771784 time 233317771784 state 0x1 ref 1 00000100:00100000:3.0:1789762930.930585:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233367771784 time 233367815669 state 0x0 ref 1 00000100:00100000:3.0:1789762930.930612:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246617088:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762930.930662:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 66060288, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x1f800 00010000:00010000:3.0:1789762930.930682:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.930699:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:3.0:1789762930.930705:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762930.930712:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.930727:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.935038:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967596 is committed 00002000:00010000:3.0:1789762930.935090:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:3.0:1789762930.935096:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 129024 -> 131072 00010000:00010000:3.0:1789762930.935106:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.935118:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.935128:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.935145:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.935150:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.935161:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.935179:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.935188:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.935239:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246617088:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4636us (48039us total) trans 4294967596 rc 0/0 00000100:00100000:3.0:1789762930.935248:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:3.0:1789762930.935259:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233367771784 time 233367815669 state 0x2 ref 0 00000100:00100000:0.0:1789762930.937287:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762930.937329:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617216 00000100:00100000:3.0:1789762930.937337:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617216 00000100:00100000:3.0:1789762930.937372:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233367771784 time 233367815669 state 0x0 ref 1 00000100:00100000:3.0:1789762930.937382:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233417815669 time 233367815669 state 0x1 ref 1 00000100:00100000:3.0:1789762930.980625:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233417815669 time 233417861138 state 0x0 ref 1 00000100:00100000:3.0:1789762930.980651:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246617216:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762930.980704:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 67108864, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x20000 00010000:00010000:3.0:1789762930.980712:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.980724:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:3.0:1789762930.980727:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762930.980732:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.980742:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762930.985031:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967597 is committed 00002000:00010000:3.0:1789762930.985099:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:3.0:1789762930.985104:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 131072 -> 133120 00010000:00010000:3.0:1789762930.985114:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.985126:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.985136:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.985145:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762930.985157:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.985164:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.985176:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762930.985181:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5adbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762930.985230:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246617216:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4583us (47944us total) trans 4294967597 rc 0/0 00000100:00100000:3.0:1789762930.985237:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:3.0:1789762930.985244:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233417815669 time 233417861138 state 0x2 ref 0 00000100:00100000:0.0:1789762930.987438:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762930.987492:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617344 00000100:00100000:2.0:1789762930.987500:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617344 00000100:00100000:2.0:1789762930.987533:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233417815669 time 233417861138 state 0x0 ref 1 00000100:00100000:2.0:1789762930.987544:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233467861138 time 233417861138 state 0x1 ref 1 00000100:00100000:2.0:1789762931.030706:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233467861138 time 233467938505 state 0x0 ref 1 00000100:00100000:2.0:1789762931.030743:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246617344:12345-192.168.203.36@tcp:4:dd.500 00000100:00080000:3.0:1789762931.030773:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789762931.030817:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 68157440, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x20800 00010000:00010000:2.0:1789762931.030825:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.030837:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762931.030841:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.030846:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.030857:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762931.034885:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967598 is committed 00002000:00010000:2.0:1789762931.034940:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:2.0:1789762931.034945:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 133120 -> 135168 00010000:00010000:2.0:1789762931.034952:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.034969:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.034975:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.034980:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.034983:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.034997:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.035010:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.035015:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.035065:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246617344:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4344us (47628us total) trans 4294967598 rc 0/0 00000100:00100000:2.0:1789762931.035074:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:2.0:1789762931.035085:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233467861138 time 233467938505 state 0x2 ref 0 00000100:00100000:1.0:1789762931.037166:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.037207:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617472 00000100:00100000:3.0:1789762931.037216:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617472 00000100:00100000:3.0:1789762931.037265:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233467861138 time 233467938505 state 0x0 ref 1 00000100:00100000:3.0:1789762931.037280:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233517938505 time 233467938505 state 0x1 ref 1 00000100:00100000:0.0:1789762931.075714:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762931.075783:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762931.075789:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617600 00000100:00100000:1.0:1789762931.075798:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617600 00000100:00100000:0.0:1789762931.075812:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.075837:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617728 00000100:00100000:3.0:1789762931.075843:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617728 00000100:00100000:2.0:1789762931.075855:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617984 00000100:00100000:1.0:1789762931.075858:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 265 00000100:00100000:0.0:1789762931.075865:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.075869:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617984 00000100:00100000:1.0:1789762931.075874:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2353:x1876702246617600:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762931.075895:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246617856 00000100:00100000:0.0:1789762931.075901:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246617856 00000100:00100000:3.0:1789762931.075913:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:2.0:1789762931.075923:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:3.0:1789762931.075928:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:2354:x1876702246617728:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762931.075938:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246617984:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762931.075944:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2353:x1876702246617600:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762931.075952:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1789762931.075957:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 265 00000100:00100000:0.0:1789762931.075969:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:2353:x1876702246617856:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762931.075974:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:2354:x1876702246617728:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 52us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762931.075984:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:2.0:1789762931.075996:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2354:x1876702246617984:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762931.076003:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 147 00000100:00080000:3.0:1789762931.076014:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762931.076018:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:2353:x1876702246617856:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00080000:3.0:1789762931.076022:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762931.076027:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:2.0:1789762931.080775:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233517938505 time 233518013920 state 0x0 ref 1 00000100:00100000:2.0:1789762931.080788:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246617472:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762931.080824:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 69206016, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x21000 00010000:00010000:2.0:1789762931.080832:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.080845:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762931.080849:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.080853:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.080864:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762931.084649:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967599 is committed 00002000:00010000:2.0:1789762931.084726:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:2.0:1789762931.084731:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 135168 -> 137216 00010000:00010000:2.0:1789762931.084739:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.084774:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.084781:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.084786:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.084789:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.084795:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.084807:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.084812:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.084856:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246617472:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4070us (47691us total) trans 4294967599 rc 0/0 00000100:00100000:2.0:1789762931.084862:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:2.0:1789762931.084870:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233517938505 time 233518013920 state 0x2 ref 0 00000100:00100000:1.0:1789762931.086886:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.086926:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246618112 00000100:00100000:3.0:1789762931.086932:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246618112 00000100:00100000:3.0:1789762931.086961:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233517938505 time 233518013920 state 0x0 ref 1 00000100:00100000:3.0:1789762931.086971:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233568013920 time 233518013920 state 0x1 ref 1 00000100:00100000:3.0:1789762931.130830:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233568013920 time 233568065617 state 0x0 ref 1 00000100:00100000:3.0:1789762931.130846:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2355:x1876702246618112:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.130881:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 70254592, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x21800 00010000:00010000:3.0:1789762931.130887:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.130898:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:3.0:1789762931.130902:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.130906:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.130928:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762931.135035:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967600 is committed 00002000:00010000:3.0:1789762931.135109:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:3.0:1789762931.135115:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 137216 -> 139264 00010000:00010000:3.0:1789762931.135124:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.135136:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.135143:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.135147:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.135150:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.135156:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.135168:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.135174:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5add1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.135243:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2355:x1876702246618112:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4399us (48356us total) trans 4294967600 rc 0/0 00000100:00100000:3.0:1789762931.135254:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:3.0:1789762931.135265:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233568013920 time 233568065617 state 0x2 ref 0 00000100:00100000:1.0:1789762931.137204:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.137254:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246618240 00000100:00100000:2.0:1789762931.137261:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246618240 00000100:00100000:2.0:1789762931.137292:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233568013920 time 233568065617 state 0x0 ref 1 00000100:00100000:2.0:1789762931.137303:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233618065617 time 233568065617 state 0x1 ref 1 00000100:00100000:1.0:1789762931.180904:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233618065617 time 233618141535 state 0x0 ref 1 00000100:00100000:1.0:1789762931.180921:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2356:x1876702246618240:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762931.180951:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 71303168, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x22000 00010000:00010000:1.0:1789762931.180957:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.180968:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:1.0:1789762931.180971:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762931.180985:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.180999:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762931.184899:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967601 is committed 00002000:00010000:3.0:1789762931.184953:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:3.0:1789762931.184958:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 139264 -> 141312 00010000:00010000:3.0:1789762931.184966:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.184975:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.184981:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.184986:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.184991:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.185001:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.185017:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.185040:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5add8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.185091:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2356:x1876702246618240:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4173us (47887us total) trans 4294967601 rc 0/0 00000100:00100000:3.0:1789762931.185101:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:3.0:1789762931.185111:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233618065617 time 233618141535 state 0x2 ref 0 00000100:00100000:0.0:1789762931.187324:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.187371:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246618368 00000100:00100000:2.0:1789762931.187379:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246618368 00000100:00100000:2.0:1789762931.187411:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233618065617 time 233618141535 state 0x0 ref 1 00000100:00100000:2.0:1789762931.187421:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233668141535 time 233618141535 state 0x1 ref 1 00000100:00100000:2.0:1789762931.230981:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233668141535 time 233668211934 state 0x0 ref 1 00000100:00100000:2.0:1789762931.231010:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246618368:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762931.231056:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 72351744, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x22800 00010000:00010000:2.0:1789762931.231063:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.231076:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762931.231080:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.231085:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.231095:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762931.235269:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967602 is committed 00002000:00010000:2.0:1789762931.235358:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:2.0:1789762931.235363:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 141312 -> 143360 00010000:00010000:2.0:1789762931.235371:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.235380:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.235386:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.235391:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.235394:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.235401:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.235413:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.235418:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5addf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.235470:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246618368:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4467us (48147us total) trans 4294967602 rc 0/0 00000100:00100000:2.0:1789762931.235483:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:2.0:1789762931.235491:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233668141535 time 233668211934 state 0x2 ref 0 00000100:00100000:0.0:1789762931.237821:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.237861:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246618496 00000100:00100000:3.0:1789762931.237869:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246618496 00000100:00100000:3.0:1789762931.237903:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233668141535 time 233668211934 state 0x0 ref 1 00000100:00100000:3.0:1789762931.237914:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233718211934 time 233668211934 state 0x1 ref 1 00000100:00100000:3.0:1789762931.281033:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233718211934 time 233718266050 state 0x0 ref 1 00000100:00100000:3.0:1789762931.281053:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246618496:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.281107:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 73400320, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x23000 00010000:00010000:3.0:1789762931.281115:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.281127:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:3.0:1789762931.281141:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.281146:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.281158:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762931.285205:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967603 is committed 00002000:00010000:3.0:1789762931.285259:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:3.0:1789762931.285263:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 143360 -> 145408 00010000:00010000:3.0:1789762931.285271:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.285278:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.285285:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.285289:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.285293:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.285299:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.285312:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.285326:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ade6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.285383:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246618496:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4334us (47563us total) trans 4294967603 rc 0/0 00000100:00100000:3.0:1789762931.285393:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:3.0:1789762931.285403:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233718211934 time 233718266050 state 0x2 ref 0 00000100:00100000:1.0:1789762931.287721:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.287775:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246618624 00000100:00100000:3.0:1789762931.287782:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246618624 00000100:00100000:3.0:1789762931.287814:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233718211934 time 233718266050 state 0x0 ref 1 00000100:00100000:3.0:1789762931.287824:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233768266050 time 233718266050 state 0x1 ref 1 00000100:00100000:3.0:1789762931.331087:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233768266050 time 233768321272 state 0x0 ref 1 00000100:00100000:3.0:1789762931.331105:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246618624:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.331143:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 74448896, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x23800 00010000:00010000:3.0:1789762931.331150:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.331162:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:3.0:1789762931.331174:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.331189:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.331200:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762931.335458:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967604 is committed 00002000:00010000:3.0:1789762931.335509:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:3.0:1789762931.335514:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 145408 -> 147456 00010000:00010000:3.0:1789762931.335522:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.335530:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.335536:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.335541:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.335544:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.335551:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.335563:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.335577:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aded lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.335634:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246618624:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4532us (47911us total) trans 4294967604 rc 0/0 00000100:00100000:3.0:1789762931.335644:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:3.0:1789762931.335654:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233768266050 time 233768321272 state 0x2 ref 0 00000100:00100000:1.0:1789762931.337808:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.337850:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246618752 00000100:00100000:2.0:1789762931.337857:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246618752 00000100:00100000:2.0:1789762931.337891:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233768266050 time 233768321272 state 0x0 ref 1 00000100:00100000:2.0:1789762931.337901:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233818321272 time 233768321272 state 0x1 ref 1 00000100:00100000:2.0:1789762931.381156:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233818321272 time 233818389491 state 0x0 ref 1 00000100:00100000:2.0:1789762931.381175:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246618752:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762931.381216:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 75497472, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x24000 00010000:00010000:2.0:1789762931.381223:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.381235:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762931.381239:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.381243:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.381253:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762931.385096:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967605 is committed 00002000:00010000:2.0:1789762931.385187:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:2.0:1789762931.385191:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 147456 -> 149504 00010000:00010000:2.0:1789762931.385199:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.385207:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.385213:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.385218:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.385221:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.385227:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.385239:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.385244:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.385293:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246618752:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4124us (47488us total) trans 4294967605 rc 0/0 00000100:00100000:2.0:1789762931.385306:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:2.0:1789762931.385314:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233818321272 time 233818389491 state 0x2 ref 0 00000100:00100000:1.0:1789762931.387420:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.387469:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246618880 00000100:00100000:3.0:1789762931.387477:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246618880 00000100:00100000:3.0:1789762931.387511:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233818321272 time 233818389491 state 0x0 ref 1 00000100:00100000:3.0:1789762931.387522:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233868389491 time 233818389491 state 0x1 ref 1 00000100:00100000:2.0:1789762931.431270:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233868389491 time 233868504315 state 0x0 ref 1 00000100:00100000:2.0:1789762931.431290:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246618880:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762931.431328:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 76546048, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x24800 00010000:00010000:2.0:1789762931.431335:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.431347:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:2.0:1789762931.431351:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.431355:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.431367:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762931.437170:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967606 is committed 00002000:00010000:2.0:1789762931.437247:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:2.0:1789762931.437252:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 149504 -> 151552 00010000:00010000:2.0:1789762931.437259:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.437268:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.437286:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.437292:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.437295:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.437302:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.437315:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.437321:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5adfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.437371:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246618880:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6086us (49951us total) trans 4294967606 rc 0/0 00000100:00100000:2.0:1789762931.437378:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:2.0:1789762931.437385:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233868389491 time 233868504315 state 0x2 ref 0 00000100:00100000:0.0:1789762931.440688:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.440779:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619008 00000100:00100000:3.0:1789762931.440793:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619008 00000100:00100000:3.0:1789762931.440859:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233868389491 time 233868504315 state 0x0 ref 1 00000100:00100000:3.0:1789762931.440870:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233918504315 time 233868504315 state 0x1 ref 1 00000100:00100000:3.0:1789762931.481330:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233918504315 time 233918561248 state 0x0 ref 1 00000100:00100000:3.0:1789762931.481391:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619008:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.481454:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 77594624, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x25000 00010000:00010000:3.0:1789762931.481462:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.481477:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:3.0:1789762931.481481:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.481485:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.481498:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762931.486967:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967607 is committed 00002000:00010000:3.0:1789762931.487099:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:3.0:1789762931.487103:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 151552 -> 153600 00010000:00010000:3.0:1789762931.487111:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.487119:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.487126:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.487131:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.487141:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.487148:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.487161:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.487166:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.487255:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619008:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5890us (46566us total) trans 4294967607 rc 0/0 00000100:00100000:3.0:1789762931.487265:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:3.0:1789762931.487277:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233918504315 time 233918561248 state 0x2 ref 0 00000100:00100000:1.0:1789762931.490405:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.490477:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619136 00000100:00100000:2.0:1789762931.490487:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619136 00000100:00100000:2.0:1789762931.490542:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233918504315 time 233918561248 state 0x0 ref 1 00000100:00100000:2.0:1789762931.490562:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233968561248 time 233918561248 state 0x1 ref 1 00000100:00100000:1.0:1789762931.531424:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233968561248 time 233968660909 state 0x0 ref 1 00000100:00100000:1.0:1789762931.531440:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619136:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762931.531492:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 78643200, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x25800 00010000:00010000:1.0:1789762931.531499:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.531511:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=233s v=(0 0) 00010000:00010000:1.0:1789762931.531514:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762931.531519:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.531552:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789762931.536568:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967608 is committed 00002000:00010000:3.0:1789762931.536678:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789762931.536684:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 153600 -> 155648 00010000:00010000:3.0:1789762931.536693:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.536702:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.536726:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.536746:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.536750:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.536761:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.536816:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.536823:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021115d4c/0x5915dfb1c1b5ae09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.536877:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619136:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5440us (46471us total) trans 4294967608 rc 0/0 00000100:00100000:3.0:1789762931.536885:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:3.0:1789762931.536894:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233968561248 time 233968660909 state 0x2 ref 0 00000100:00100000:0.0:1789762931.539275:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.539335:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619264 00000100:00100000:2.0:1789762931.539344:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619264 00000100:00100000:2.0:1789762931.539391:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 233968561248 time 233968660909 state 0x0 ref 1 00000100:00100000:2.0:1789762931.539401:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234018660909 time 233968660909 state 0x1 ref 1 00010000:00010000:0.0:1789762931.578874:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762931.581472:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234018660909 time 234018710608 state 0x0 ref 1 00000100:00100000:2.0:1789762931.581487:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619264:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762931.581516:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 79691776, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x26000 00010000:00010000:2.0:1789762931.581523:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.581534:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762931.581537:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.581541:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.581550:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762931.586108:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967609 is committed 00002000:00010000:1.0:1789762931.586201:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:1.0:1789762931.586211:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 155648 -> 157696 00010000:00010000:1.0:1789762931.586219:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.586227:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.586233:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.586240:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762931.586244:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.586254:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.586269:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.586279:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5ae10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762931.586332:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619264:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4848us (47058us total) trans 4294967609 rc 0/0 00000100:00100000:1.0:1789762931.586340:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:1.0:1789762931.586347:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234018660909 time 234018710608 state 0x2 ref 0 00000100:00100000:2.0:1789762931.588214:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.588256:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619392 00000100:00100000:3.0:1789762931.588263:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619392 00000100:00100000:3.0:1789762931.588294:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234018660909 time 234018710608 state 0x0 ref 1 00000100:00100000:3.0:1789762931.588308:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234068710608 time 234018710608 state 0x1 ref 1 00000100:00100000:3.0:1789762931.631562:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234068710608 time 234068792044 state 0x0 ref 1 00000100:00100000:3.0:1789762931.631590:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619392:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.631635:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 80740352, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x26800 00010000:00010000:3.0:1789762931.631676:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.631689:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:3.0:1789762931.631692:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.631697:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.631707:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762931.636778:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967610 is committed 00002000:00010000:3.0:1789762931.636831:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:3.0:1789762931.636835:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 157696 -> 159744 00010000:00010000:3.0:1789762931.636842:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.636850:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.636856:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.636872:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.636875:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.636881:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.636891:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.636896:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.636943:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619392:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5363us (48730us total) trans 4294967610 rc 0/0 00000100:00100000:3.0:1789762931.636949:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:3.0:1789762931.636956:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234068710608 time 234068792044 state 0x2 ref 0 00000100:00100000:0.0:1789762931.639249:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.639286:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619520 00000100:00100000:3.0:1789762931.639292:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619520 00000100:00100000:3.0:1789762931.639326:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234068710608 time 234068792044 state 0x0 ref 1 00000100:00100000:3.0:1789762931.639338:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234118792044 time 234068792044 state 0x1 ref 1 00000100:00100000:3.0:1789762931.681704:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234118792044 time 234118936345 state 0x0 ref 1 00000100:00100000:3.0:1789762931.681824:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619520:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.681913:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 81788928, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x27000 00010000:00010000:3.0:1789762931.681926:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.681960:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:3.0:1789762931.681964:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.681969:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.681982:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762931.688376:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967611 is committed 00002000:00010000:3.0:1789762931.688470:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:3.0:1789762931.688476:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 159744 -> 161792 00010000:00010000:3.0:1789762931.688503:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.688519:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.688531:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.688540:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.688559:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.688572:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.688594:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.688603:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.688694:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619520:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6938us (49445us total) trans 4294967611 rc 0/0 00000100:00100000:3.0:1789762931.688718:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:3.0:1789762931.688727:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234118792044 time 234118936345 state 0x2 ref 0 00000100:00100000:2.0:1789762931.692016:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762931.692065:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619648 00000100:00100000:1.0:1789762931.692074:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619648 00000100:00100000:1.0:1789762931.692143:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234118792044 time 234118936345 state 0x0 ref 1 00000100:00100000:1.0:1789762931.692158:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234168936345 time 234118936345 state 0x1 ref 1 00000100:00100000:2.0:1789762931.731789:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234168936345 time 234169024107 state 0x0 ref 1 00000100:00100000:2.0:1789762931.731810:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619648:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762931.731851:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 82837504, mtime: 0x6aad9d73, atime: 0x0, ctime: 0x6aad9d73, blocks: 0x27800 00010000:00010000:2.0:1789762931.731858:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.731870:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762931.731873:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.731878:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.731888:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762931.737176:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967612 is committed 00002000:00010000:2.0:1789762931.737245:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:2.0:1789762931.737250:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 1789762931 -> 1789762932 00002000:00010000:2.0:1789762931.737252:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 1789762931 -> 1789762932 00002000:00010000:2.0:1789762931.737254:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 161792 -> 163840 00010000:00010000:2.0:1789762931.737279:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.737298:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.737304:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.737309:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.737313:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.737319:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.737331:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.737336:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.737386:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619648:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5582us (45371us total) trans 4294967612 rc 0/0 00000100:00100000:2.0:1789762931.737395:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1789762931.737406:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234168936345 time 234169024107 state 0x2 ref 0 00000100:00100000:1.0:1789762931.740024:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.740055:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619776 00000100:00100000:3.0:1789762931.740065:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619776 00000100:00100000:3.0:1789762931.740129:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234168936345 time 234169024107 state 0x0 ref 1 00000100:00100000:3.0:1789762931.740142:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234219024107 time 234169024107 state 0x1 ref 1 00000100:00100000:2.0:1789762931.781865:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234219024107 time 234219099541 state 0x0 ref 1 00000100:00100000:2.0:1789762931.781892:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619776:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762931.781962:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 83886080, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x28000 00010000:00010000:2.0:1789762931.781972:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.781990:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762931.781995:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762931.782002:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.782017:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762931.788039:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967613 is committed 00002000:00010000:2.0:1789762931.788139:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:2.0:1789762931.788143:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 163840 -> 165888 00010000:00010000:2.0:1789762931.788151:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.788160:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.788166:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.788171:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.788180:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.788187:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.788199:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.788204:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.788258:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246619776:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6368us (48233us total) trans 4294967613 rc 0/0 00000100:00100000:2.0:1789762931.788269:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:2.0:1789762931.788279:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234219024107 time 234219099541 state 0x2 ref 0 00000100:00100000:0.0:1789762931.791105:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.791144:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246619904 00000100:00100000:3.0:1789762931.791152:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246619904 00000100:00100000:3.0:1789762931.791187:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234219024107 time 234219099541 state 0x0 ref 1 00000100:00100000:3.0:1789762931.791207:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234269099541 time 234219099541 state 0x1 ref 1 00000100:00100000:3.0:1789762931.831985:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234269099541 time 234269207767 state 0x0 ref 1 00000100:00100000:3.0:1789762931.832147:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619904:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.832211:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 84934656, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x28800 00010000:00010000:3.0:1789762931.832225:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.832248:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:3.0:1789762931.832254:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.832264:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.832285:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762931.838568:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967614 is committed 00002000:00010000:3.0:1789762931.838701:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789762931.838710:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 165888 -> 167936 00010000:00010000:3.0:1789762931.838726:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.838743:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.838808:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.838819:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.838826:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.838842:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.838868:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.838881:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.838977:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246619904:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6840us (47867us total) trans 4294967614 rc 0/0 00000100:00100000:3.0:1789762931.838991:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:3.0:1789762931.839007:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234269099541 time 234269207767 state 0x2 ref 0 00000100:00100000:1.0:1789762931.841992:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.842067:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620032 00000100:00100000:2.0:1789762931.842078:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620032 00000100:00100000:2.0:1789762931.842127:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234269099541 time 234269207767 state 0x0 ref 1 00000100:00100000:2.0:1789762931.842141:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234319207767 time 234269207767 state 0x1 ref 1 00000100:00100000:1.0:1789762931.882107:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234319207767 time 234319334913 state 0x0 ref 1 00000100:00100000:1.0:1789762931.882136:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620032:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762931.882201:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 85983232, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x29000 00010000:00010000:1.0:1789762931.882210:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.882229:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:1.0:1789762931.882234:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762931.882250:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.882267:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762931.887622:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967615 is committed 00002000:00010000:3.0:1789762931.887805:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789762931.887812:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 167936 -> 169984 00010000:00010000:3.0:1789762931.887824:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.887865:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.887873:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.887878:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.887882:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.887890:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.887905:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.887911:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.887972:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620032:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5848us (45984us total) trans 4294967615 rc 0/0 00000100:00100000:3.0:1789762931.887981:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:3.0:1789762931.887991:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234319207767 time 234319334913 state 0x2 ref 0 00000100:00100000:1.0:1789762931.890461:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762931.890522:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620160 00000100:00100000:2.0:1789762931.890531:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620160 00000100:00100000:2.0:1789762931.890572:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234319207767 time 234319334913 state 0x0 ref 1 00000100:00100000:2.0:1789762931.890595:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234369334913 time 234319334913 state 0x1 ref 1 00000100:00100000:1.0:1789762931.932242:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234369334913 time 234369463801 state 0x0 ref 1 00000100:00100000:1.0:1789762931.932277:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620160:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762931.932346:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 87031808, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x29800 00010000:00010000:1.0:1789762931.932360:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.932384:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:1.0:1789762931.932390:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762931.932397:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762931.932413:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762931.937398:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967616 is committed 00002000:00010000:2.0:1789762931.937513:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:2.0:1789762931.937519:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 169984 -> 172032 00010000:00010000:2.0:1789762931.937529:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.937539:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.937546:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.937552:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762931.937556:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.937564:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.937578:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762931.937584:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048633850/0x5915dfb1c1b5ae41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762931.937657:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620160:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5393us (47197us total) trans 4294967616 rc 0/0 00000100:00100000:2.0:1789762931.937684:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:2.0:1789762931.937694:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234369334913 time 234369463801 state 0x2 ref 0 00000100:00100000:0.0:1789762931.940451:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.940500:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620288 00000100:00100000:3.0:1789762931.940517:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620288 00000100:00100000:3.0:1789762931.940557:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234369334913 time 234369463801 state 0x0 ref 1 00000100:00100000:3.0:1789762931.940569:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234419463801 time 234369463801 state 0x1 ref 1 00000100:00100000:3.0:1789762931.982317:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234419463801 time 234419547604 state 0x0 ref 1 00000100:00100000:3.0:1789762931.982340:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620288:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762931.982388:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 88080384, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2a000 00010000:00010000:3.0:1789762931.982397:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.982413:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:3.0:1789762931.982418:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762931.982424:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.982437:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762931.988517:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967617 is committed 00002000:00010000:3.0:1789762931.988624:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:3.0:1789762931.988632:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 172032 -> 174080 00010000:00010000:3.0:1789762931.988643:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.988656:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.988716:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.988728:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762931.988734:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.988749:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.988801:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762931.988811:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762931.988878:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620288:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6543us (48426us total) trans 4294967617 rc 0/0 00000100:00100000:3.0:1789762931.988887:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:3.0:1789762931.988897:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234419463801 time 234419547604 state 0x2 ref 0 00000100:00100000:2.0:1789762931.992187:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762931.992259:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620416 00000100:00100000:3.0:1789762931.992270:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620416 00000100:00100000:3.0:1789762931.992339:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234419463801 time 234419547604 state 0x0 ref 1 00000100:00100000:3.0:1789762931.992379:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234469547604 time 234419547604 state 0x1 ref 1 00000100:00100000:3.0:1789762932.032410:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234469547604 time 234469639695 state 0x0 ref 1 00000100:00100000:3.0:1789762932.032439:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620416:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762932.032489:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 89128960, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2a800 00010000:00010000:3.0:1789762932.032498:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.032514:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:3.0:1789762932.032519:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762932.032525:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.032538:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.039489:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967618 is committed 00002000:00010000:3.0:1789762932.039574:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:3.0:1789762932.039581:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 174080 -> 176128 00010000:00010000:3.0:1789762932.039592:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.039604:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.039628:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.039636:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.039640:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.039649:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.039689:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.039702:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.039822:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620416:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7390us (47636us total) trans 4294967618 rc 0/0 00000100:00100000:3.0:1789762932.039833:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:3.0:1789762932.039844:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234469547604 time 234469639695 state 0x2 ref 0 00000100:00100000:0.0:1789762932.043653:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.043795:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620544 00000100:00100000:2.0:1789762932.043810:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620544 00000100:00100000:2.0:1789762932.043870:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234469547604 time 234469639695 state 0x0 ref 1 00000100:00100000:2.0:1789762932.043886:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234519639695 time 234469639695 state 0x1 ref 1 00000100:00100000:2.0:1789762932.082507:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234519639695 time 234519730816 state 0x0 ref 1 00000100:00100000:2.0:1789762932.082540:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620544:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762932.082620:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 90177536, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2b000 00010000:00010000:2.0:1789762932.082632:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.082653:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762932.082692:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.082717:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.082756:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.089399:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967619 is committed 00002000:00010000:2.0:1789762932.089581:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:2.0:1789762932.089590:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 176128 -> 178176 00010000:00010000:2.0:1789762932.089604:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.089620:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.089631:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.089641:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762932.089647:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.089681:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.089724:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.089733:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.089879:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620544:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7347us (46223us total) trans 4294967619 rc 0/0 00000100:00100000:2.0:1789762932.089893:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:2.0:1789762932.089907:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234519639695 time 234519730816 state 0x2 ref 0 00000100:00100000:1.0:1789762932.093796:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.093862:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620672 00000100:00100000:3.0:1789762932.093873:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620672 00000100:00100000:3.0:1789762932.093923:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234519639695 time 234519730816 state 0x0 ref 1 00000100:00100000:3.0:1789762932.093951:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234569730816 time 234519730816 state 0x1 ref 1 00000100:00100000:2.0:1789762932.132683:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234569730816 time 234569901567 state 0x0 ref 1 00000100:00100000:2.0:1789762932.132708:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620672:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762932.132775:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 91226112, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2b800 00010000:00010000:2.0:1789762932.132785:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.132821:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762932.132827:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.132835:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.132852:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.139636:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967620 is committed 00002000:00010000:2.0:1789762932.139802:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:2.0:1789762932.139811:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 178176 -> 180224 00010000:00010000:2.0:1789762932.139824:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.139852:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.139864:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.139873:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762932.139879:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.139890:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.139910:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.139919:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe60a20/0x5915dfb1c1b5ae5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.140004:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620672:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7301us (46209us total) trans 4294967620 rc 0/0 00000100:00100000:2.0:1789762932.140018:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:2.0:1789762932.140032:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234569730816 time 234569901567 state 0x2 ref 0 00000100:00100000:0.0:1789762932.143891:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.143971:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620800 00000100:00100000:3.0:1789762932.143985:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620800 00000100:00100000:3.0:1789762932.144049:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234569730816 time 234569901567 state 0x0 ref 1 00000100:00100000:3.0:1789762932.144063:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234619901567 time 234569901567 state 0x1 ref 1 00000100:00100000:3.0:1789762932.182838:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234619901567 time 234620061700 state 0x0 ref 1 00000100:00100000:3.0:1789762932.182875:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620800:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762932.182937:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 92274688, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2c000 00010000:00010000:3.0:1789762932.182949:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.182970:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:3.0:1789762932.182976:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762932.182984:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.183002:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.189792:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967621 is committed 00002000:00010000:3.0:1789762932.189923:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:3.0:1789762932.189939:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 180224 -> 182272 00010000:00010000:3.0:1789762932.189951:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.189963:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.189972:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.189982:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.189988:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.190003:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.190028:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.190042:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.190120:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246620800:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7259us (46232us total) trans 4294967621 rc 0/0 00000100:00100000:3.0:1789762932.190130:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:3.0:1789762932.190141:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234619901567 time 234620061700 state 0x2 ref 0 00000100:00100000:2.0:1789762932.193298:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.193355:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246620928 00000100:00100000:3.0:1789762932.193366:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246620928 00000100:00100000:3.0:1789762932.193447:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234619901567 time 234620061700 state 0x0 ref 1 00000100:00100000:3.0:1789762932.193467:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234670061700 time 234620061700 state 0x1 ref 1 00000100:00100000:1.0:1789762932.233052:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234670061700 time 234670255484 state 0x0 ref 1 00000100:00100000:1.0:1789762932.233116:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620928:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762932.233164:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 93323264, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2c800 00010000:00010000:1.0:1789762932.233174:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.233197:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:1.0:1789762932.233203:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762932.233213:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.233233:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.240360:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967622 is committed 00002000:00010000:3.0:1789762932.240499:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:3.0:1789762932.240507:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 182272 -> 184320 00010000:00010000:3.0:1789762932.240520:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.240534:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.240544:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.240551:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.240557:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.240566:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.240584:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.240613:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21cd760/0x5915dfb1c1b5ae6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.240729:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246620928:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7635us (47429us total) trans 4294967622 rc 0/0 00000100:00100000:3.0:1789762932.240743:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:3.0:1789762932.240816:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234670061700 time 234670255484 state 0x2 ref 0 00000100:00100000:0.0:1789762932.244392:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.244453:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621056 00000100:00100000:2.0:1789762932.244464:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621056 00000100:00100000:2.0:1789762932.244513:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234670061700 time 234670255484 state 0x0 ref 1 00000100:00100000:2.0:1789762932.244528:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234720255484 time 234670255484 state 0x1 ref 1 00000100:00100000:2.0:1789762932.283175:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234720255484 time 234720388992 state 0x0 ref 1 00000100:00100000:2.0:1789762932.283222:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246621056:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762932.283320:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 94371840, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2d000 00010000:00010000:2.0:1789762932.283331:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.283368:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762932.283372:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.283379:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.283395:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.290703:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967623 is committed 00002000:00010000:3.0:1789762932.290812:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:3.0:1789762932.290819:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 184320 -> 186368 00010000:00010000:3.0:1789762932.290832:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.290845:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.290855:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.290862:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.290867:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.290877:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.290910:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.290918:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091071ac/0x5915dfb1c1b5ae72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.290992:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246621056:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7787us (46601us total) trans 4294967623 rc 0/0 00000100:00100000:3.0:1789762932.291001:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:3.0:1789762932.291013:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234720255484 time 234720388992 state 0x2 ref 0 00000100:00100000:2.0:1789762932.295400:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.295468:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621184 00000100:00100000:3.0:1789762932.295499:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621184 00000100:00100000:3.0:1789762932.295561:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234720255484 time 234720388992 state 0x0 ref 1 00000100:00100000:3.0:1789762932.295581:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234770388992 time 234720388992 state 0x1 ref 1 00000100:00100000:1.0:1789762932.333324:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234770388992 time 234770553748 state 0x0 ref 1 00000100:00100000:1.0:1789762932.333373:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246621184:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762932.333440:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 95420416, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2d800 00010000:00010000:1.0:1789762932.333481:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.333498:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:1.0:1789762932.333503:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762932.333521:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.333538:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.340292:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967624 is committed 00002000:00010000:3.0:1789762932.340394:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:3.0:1789762932.340401:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 186368 -> 188416 00010000:00010000:3.0:1789762932.340412:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.340424:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.340448:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.340456:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.340460:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.340470:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.340486:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.340494:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dca7b39f/0x5915dfb1c1b5ae79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.340608:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246621184:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7265us (45209us total) trans 4294967624 rc 0/0 00000100:00100000:3.0:1789762932.340618:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:3.0:1789762932.340630:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234770388992 time 234770553748 state 0x2 ref 0 00000100:00100000:0.0:1789762932.343875:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.343945:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621312 00000100:00100000:3.0:1789762932.343975:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621312 00000100:00100000:3.0:1789762932.344033:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234770388992 time 234770553748 state 0x0 ref 1 00000100:00100000:3.0:1789762932.344083:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234820553748 time 234770553748 state 0x1 ref 1 00000100:00100000:3.0:1789762932.383457:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234820553748 time 234820678451 state 0x0 ref 1 00000100:00100000:3.0:1789762932.383518:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246621312:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762932.383595:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 96468992, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2e000 00010000:00010000:3.0:1789762932.383611:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.383650:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:3.0:1789762932.383678:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762932.383689:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.383710:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.391377:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967625 is committed 00002000:00010000:3.0:1789762932.391455:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:3.0:1789762932.391462:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 188416 -> 190464 00010000:00010000:3.0:1789762932.391474:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.391486:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.391511:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.391519:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.391523:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.391532:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.391549:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.391557:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5ae80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.391629:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246621312:12345-192.168.203.36@tcp:4:dd.500 Request processed in 8129us (47759us total) trans 4294967625 rc 0/0 00000100:00100000:3.0:1789762932.391639:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:3.0:1789762932.391649:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234820553748 time 234820678451 state 0x2 ref 0 00000100:00100000:1.0:1789762932.395624:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.395714:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621440 00000100:00100000:3.0:1789762932.395742:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621440 00000100:00100000:3.0:1789762932.395839:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234820553748 time 234820678451 state 0x0 ref 1 00000100:00100000:3.0:1789762932.395882:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234870678451 time 234820678451 state 0x1 ref 1 00000100:00100000:2.0:1789762932.433625:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234870678451 time 234870829410 state 0x0 ref 1 00000100:00100000:2.0:1789762932.433683:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246621440:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762932.433840:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 97517568, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2e800 00010000:00010000:2.0:1789762932.433851:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.433874:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762932.433881:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.433892:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.433914:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.440900:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967626 is committed 00002000:00010000:2.0:1789762932.441008:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:2.0:1789762932.441018:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 190464 -> 192512 00010000:00010000:2.0:1789762932.441034:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.441052:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.441069:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.441082:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762932.441091:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.441127:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.441153:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.441167:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.441263:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246621440:12345-192.168.203.36@tcp:4:dd.500 Request processed in 7611us (45656us total) trans 4294967626 rc 0/0 00000100:00100000:2.0:1789762932.441281:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:2.0:1789762932.441298:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234870678451 time 234870829410 state 0x2 ref 0 00000100:00100000:1.0:1789762932.444946:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.445020:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621568 00000100:00100000:3.0:1789762932.445034:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621568 00000100:00100000:3.0:1789762932.445094:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234870678451 time 234870829410 state 0x0 ref 1 00000100:00100000:3.0:1789762932.445115:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234920829410 time 234870829410 state 0x1 ref 1 00000100:00100000:2.0:1789762932.483759:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234920829410 time 234920982556 state 0x0 ref 1 00000100:00100000:2.0:1789762932.483838:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246621568:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762932.483928:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 98566144, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2f000 00010000:00010000:2.0:1789762932.483940:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.483959:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1789762932.483966:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.483972:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.484002:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.489828:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967627 is committed 00002000:00010000:2.0:1789762932.489948:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:2.0:1789762932.489956:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 192512 -> 194560 00010000:00010000:2.0:1789762932.489968:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.489982:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.489993:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.490002:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762932.490008:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.490019:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.490040:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.490050:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5ae8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.490151:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246621568:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6327us (45202us total) trans 4294967627 rc 0/0 00000100:00100000:2.0:1789762932.490164:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:2.0:1789762932.490178:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234920829410 time 234920982556 state 0x2 ref 0 00000100:00100000:1.0:1789762932.493124:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.493212:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621696 00000100:00100000:3.0:1789762932.493223:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621696 00000100:00100000:3.0:1789762932.493271:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234920829410 time 234920982556 state 0x0 ref 1 00000100:00100000:3.0:1789762932.493288:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234970982556 time 234920982556 state 0x1 ref 1 00000100:00100000:0.0:1789762932.533908:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234970982556 time 234971133761 state 0x0 ref 1 00000100:00100000:0.0:1789762932.533957:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246621696:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762932.534032:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 99614720, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x2f800 00010000:00010000:0.0:1789762932.534042:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.534071:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=234s v=(0 0) 00010000:00010000:0.0:1789762932.534076:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762932.534082:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.534096:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762932.539080:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 234976326586ns, next at 235976323224ns, rc = 0 00000100:00100000:1.0:1789762932.539101:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789762932.539118:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254926976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762932.539176:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762932.539241:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254926976 00000100:00100000:0.0:1789762932.539251:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254926976 00000100:00080000:3.0:1789762932.539349:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762932.539360:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789762932.539370:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254926976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762932.539388:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 485990976 pending 1073152 free 3855511552 avail 3582136320 00000100:00100000:0.0:1789762932.539451:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254926976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762932.539460:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789762932.539516:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254926976:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789762932.540115:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000001:00080000:3.0:1789762932.540376:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967628 is committed 00000004:00080000:0.0:1789762932.540399:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:0.0:1789762932.540422:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:0.0:1789762932.540452:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789762932.540456:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00002000:00010000:1.0:1789762932.540470:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:1.0:1789762932.540477:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 194560 -> 196608 00010000:00010000:1.0:1789762932.540490:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.540502:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.540515:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.540526:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254927104:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789762932.540544:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c5c35c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762932.540550:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.540560:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.540576:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789762932.540581:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.540592:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a88db4/0x5915dfb1c1b5ae95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.540637:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254927104 00000100:00100000:2.0:1789762932.540645:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254927232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789762932.540647:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254927104 00000100:00100000:1.0:1789762932.540697:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246621696:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6747us (47571us total) trans 4294967628 rc 0/0 00000100:00080000:3.0:1789762932.540700:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762932.540711:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:1.0:1789762932.540723:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234970982556 time 234971133761 state 0x2 ref 0 00000100:00100000:0.0:1789762932.540734:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789762932.540735:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762932.540782:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254927104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789762932.540804:0:6911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:7 count 1 00000100:00100000:3.0:1789762932.540808:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254927232 00000100:00100000:3.0:1789762932.540818:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254927232 00002000:00010000:0.0:1789762932.540830:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 8388608, mtime: 0x6aad9d6f, atime: 0x0, ctime: 0x6aad9d6f, blocks: 0x4000 00010000:00010000:0.0:1789762932.540840:0:6911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.540853:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=234s v=(0 0) 00010000:00010000:0.0:1789762932.540857:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762932.540863:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.540878:0:6911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.540878:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00010000:00010000:0.0:1789762932.540894:0:6911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.540900:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254927232:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789762932.540903:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789762932.540917:0:6911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.540929:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254927360:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762932.540929:0:6912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:8 count 1 00010000:00010000:0.0:1789762932.540938:0:6911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762932.540951:0:6912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.540970:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.540982:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.540992:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 11 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.541006:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789762932.541023:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 11 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541033:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541042:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 11 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.541051:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254927360 00010000:00010000:2.0:1789762932.541052:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 11 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.541063:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254927360 00010000:00010000:2.0:1789762932.541064:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 7 to [0x280000400:0x8:0x0].0x0 since=5s v=(7 0) 00010000:00010000:2.0:1789762932.541071:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 7) 00010000:00010000:2.0:1789762932.541076:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 10/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.541087:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254927104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 337us (507us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789762932.541097:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:2.0:1789762932.541112:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x50000000030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 11 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.541121:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000004:00080000:1.0:1789762932.541127:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c2162300/2, rc 0, transno 4294967330 00010000:00010000:2.0:1789762932.541136:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x70000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 11 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.541138:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254927104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762932.541145:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fc732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254927360:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762932.541171:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254927488:192.168.203.36@tcp:104: 00002000:00080000:3.0:1789762932.541177:0:12943:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:8 count 1 00010000:00010000:1.0:1789762932.541181:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762932.541198:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541204:0:12943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.541211:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c5c35600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762932.541221:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541230:0:12943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 13 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.541236:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541249:0:12943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 13 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541258:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789762932.541264:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541264:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762932.541271:0:12943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 5/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.541282:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001381ac9e/0x5915dfb1c1b5ae9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541288:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 11 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541323:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x70000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 11 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541323:0:12943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 13 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.541324:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762932.541331:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762932.541336:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762932.541349:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254927616:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762932.541392:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541403:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x70000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 11 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.541414:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254927872:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762932.541450:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 11 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541460:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x70000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 11 pid: 6909 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.541471:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928000:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762932.541500:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 11 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541545:0:12943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 13 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541547:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 11 pid: 12943 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.541567:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928128:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762932.541611:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541622:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 11 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.541651:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928256:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762932.541701:0:12943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2163800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12943:1876702254927744:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762932.541729:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.541785:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 11 pid: 6911 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.541804:0:6912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928384:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762932.541867:0:6912:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33f4511300 going to sleep for 11 seconds 00010000:00010000:3.0:1789762932.541963:0:12943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 13 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.541976:0:12943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 13 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.542138:0:12943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2161880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12943:1876702254928512:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762932.542191:0:12943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c8a879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789762932.545096:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.545138:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254927488:192.168.203.36@tcp:104: 00000100:00100000:2.0:1789762932.545157:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254927616:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762932.545159:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.545213:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621952 00000100:00100000:3.0:1789762932.545224:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621952 00000100:00100000:1.0:1789762932.545239:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246621824 00000100:00100000:1.0:1789762932.545254:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246621824 00010000:00010000:3.0:1789762932.545269:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 13 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.545272:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254927872:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762932.545299:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1789762932.545303:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 13 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.545335:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928000:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762932.545339:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622080 00000100:00100000:3.0:1789762932.545355:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622080 00000100:00100000:0.0:1789762932.545370:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:2.0:1789762932.545376:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928128:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762932.545398:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2356:x1876702246621952:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762932.545398:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 14 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.545402:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928256:192.168.203.36@tcp:104: 00000100:00100000:1.0:1789762932.545424:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00010000:00010000:0.0:1789762932.545431:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762932.545463:0:7992:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.545471:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246621824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789762932.545492:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00010000:00010000:1.0:1789762932.545495:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762932.545500:0:7992:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x50000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.545517:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246622080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762932.545525:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 11 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.545537:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762932.545538:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043860527/0x5915dfb1c1b5a9da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 12 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894476e expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.545577:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 14 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.545578:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 14 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 14 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.545630:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762932.545638:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 13 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.545698:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3cb1aae/0x5915dfb1c1b5a9f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 10 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b87894477c expref: 13 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.545730:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5aa19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 11 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447b4 expref: 13 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.545731:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2356:x1876702246621952:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 322us (631us total) trans 0 rc 0/0 00010000:00010000:1.0:1789762932.545744:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762932.545762:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1789762932.545833:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2354:x1876702246621824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 387us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762932.545847:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00010000:00010000:3.0:1789762932.545847:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762932.545862:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762932.545905:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622464 00000100:00100000:3.0:1789762932.545906:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246622080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 397us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762932.545917:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622464 00000100:00100000:3.0:1789762932.545923:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00010000:00010000:1.0:1789762932.545964:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 9 pid: 12943 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.546026:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:1.0:1789762932.546046:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246622464:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789762932.546060:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1789762932.546074:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789762932.546081:0:6912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1876702254928384:192.168.203.36@tcp:104: 00010000:00010000:1.0:1789762932.546092:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 9 pid: 12943 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.546110:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1789762932.546135:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 9 pid: 12943 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.546177:0:6912:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.546190:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622208 00010000:00010000:1.0:1789762932.546195:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005445cf41/0x5915dfb1c1b5aa20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ad expref: 9 pid: 12943 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.546201:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622208 00000100:00100000:2.0:1789762932.546217:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1789762932.546237:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762932.546239:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622336 00000100:00100000:0.0:1789762932.546249:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622336 00000100:00100000:2.0:1789762932.546262:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622592 00000100:00100000:2.0:1789762932.546273:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622592 00010000:00010000:3.0:1789762932.546298:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 10 pid: 6909 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.546304:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 234970982556 time 234971133761 state 0x0 ref 1 00010000:00010000:2.0:1789762932.546309:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 10 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.546311:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246622464:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 265us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762932.546356:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:0.0:1789762932.546374:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235021133761 time 234971133761 state 0x1 ref 1 00000100:00100000:2.0:1789762932.546404:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:1.0:1789762932.546421:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:2.0:1789762932.546433:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2355:x1876702246622592:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762932.546454:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762932.546456:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2353:x1876702246622208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762932.546473:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 9 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.546482:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762932.546502:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 9 pid: 6909 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.546507:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 9 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.546528:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.546562:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622720 00000100:00100000:3.0:1789762932.546575:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622720 00010000:00010000:2.0:1789762932.546615:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068d81a89/0x5915dfb1c1b5a9cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944760 expref: 10 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.546625:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 10 pid: 6909 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.546626:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 9 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 10 pid: 6911 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.546725:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762932.546728:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef8d9438/0x5915dfb1c1b5aa12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447a6 expref: 9 pid: 6909 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.546750:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762932.546761:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.546825:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246622592:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 405us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762932.546838:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:1.0:1789762932.546849:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246622208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 402us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762932.546866:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:2.0:1789762932.546870:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622976 00000100:00100000:2.0:1789762932.546878:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622976 00010000:00010000:2.0:1789762932.546913:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 15 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.546983:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.546993:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:2.0:1789762932.547010:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2354:x1876702246622976:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789762932.547025:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246622848 00010000:00010000:2.0:1789762932.547028:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789762932.547035:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246622848 00010000:00010000:2.0:1789762932.547040:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 15 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547059:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 15 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547102:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762932.547104:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00010000:00010000:0.0:1789762932.547128:0:12943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5aa9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447ec expref: 15 pid: 12136 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.547149:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246622720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789762932.547152:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2354:x1876702246622976:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762932.547190:0:12943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2163800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12943:1876702254927744:192.168.203.36@tcp:104: 00010000:00010000:1.0:1789762932.547202:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762932.547206:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00010000:00010000:1.0:1789762932.547225:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 6 pid: 6911 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.547239:0:5954:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.547244:0:12943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2161880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12943:1876702254928512:192.168.203.36@tcp:104: 00010000:00010000:1.0:1789762932.547298:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 6 pid: 6911 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.547317:0:12943:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.547334:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb484ea1/0x5915dfb1c1b5a9c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.203.36@tcp remote: 0xc03e56b878944759 expref: 6 pid: 6911 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.547362:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 7) 00010000:00010000:1.0:1789762932.547371:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(7 7) 00010000:00010000:1.0:1789762932.547381:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.547416:0:5911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.547476:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762932.547496:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00010000:00010000:0.0:1789762932.547501:0:6912:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.547518:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246622848:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762932.547519:0:6912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547558:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762932.547562:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246622720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 422us (1052us total) trans 0 rc 0/0 00010000:00010000:0.0:1789762932.547563:0:6912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547574:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.547631:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00010000:00010000:0.0:1789762932.547633:0:6912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547726:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547800:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bd3bea6/0x5915dfb1c1b5aa97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447e5 expref: 14 pid: 6912 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547817:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.547823:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.547829:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.547832:0:6912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762932.547857:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762932.547860:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.547872:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.547908:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762932.547920:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.547927:0:12943:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.547931:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.547961:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2353:x1876702246622848:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 448us (983us total) trans 0 rc 0/0 00010000:00010000:3.0:1789762932.547963:0:12943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.547978:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.547987:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3420:x1876702254927232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7086us (7252us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789762932.547994:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00010000:00010000:3.0:1789762932.548010:0:12943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.548029:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:1.0:1789762932.548036:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.548041:0:12943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762932.548053:0:3420:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c2161c00/2, rc 0, transno 4294967331 00000100:00100000:2.0:1789762932.548071:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254927232:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789762932.548087:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf5c6c90/0x5915dfb1c1b5aea3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.548102:0:12943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762932.548126:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762932.548127:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762932.548139:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.548153:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762932.548160:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.548177:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.548200:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.548228:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5aeaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.548259:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762932.548285:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762932.548290:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762932.548441:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fc732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254927360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7305us (7433us total) trans 4294967629 rc 0/0 00000100:00100000:3.0:1789762932.548470:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00080000:1.0:1789762932.548503:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c6cfb100/2, rc 0, transno 4294967629 00000100:00100000:1.0:1789762932.548527:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254927360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762932.584033:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235021133761 time 235021265025 state 0x0 ref 1 00000100:00100000:1.0:1789762932.584071:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246622336:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762932.584116:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 100663296, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x30000 00010000:00010000:1.0:1789762932.584126:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.584140:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=235s v=(0 0) 00010000:00010000:1.0:1789762932.584145:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762932.584151:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.584169:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762932.590419:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967630 is committed 00000001:00080000:3.0:1789762932.590450:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967629 is committed 00002000:00010000:1.0:1789762932.590610:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:1.0:1789762932.590631:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 196608 -> 198656 00010000:00010000:1.0:1789762932.590646:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.590693:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.590705:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.590715:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762932.590720:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.590732:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.590784:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.590795:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af38ce8/0x5915dfb1c1b5aeb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.590893:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246622336:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6831us (44782us total) trans 4294967630 rc 0/0 00000100:00100000:1.0:1789762932.590905:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:1.0:1789762932.590919:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235021133761 time 235021265025 state 0x2 ref 0 00000100:00100000:2.0:1789762932.594900:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.594983:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246623104 00000100:00100000:3.0:1789762932.594998:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246623104 00000100:00100000:3.0:1789762932.595051:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235021133761 time 235021265025 state 0x0 ref 1 00000100:00100000:3.0:1789762932.595070:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235071265025 time 235021265025 state 0x1 ref 1 00010000:00010000:0.0:1789762932.603011:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762932.634209:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235071265025 time 235071438968 state 0x0 ref 1 00000100:00100000:2.0:1789762932.634270:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fc6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2355:x1876702246623104:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762932.634346:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 101711872, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x30800 00010000:00010000:2.0:1789762932.634358:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.634378:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=235s v=(0 0) 00010000:00010000:2.0:1789762932.634384:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.634392:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.634409:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762932.642891:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967631 is committed 00002000:00010000:2.0:1789762932.642996:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:2.0:1789762932.643006:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 198656 -> 200704 00010000:00010000:2.0:1789762932.643021:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.643037:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.643049:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.643058:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762932.643064:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.643096:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.643118:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.643128:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006957058f/0x5915dfb1c1b5aeb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.643226:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fc6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2355:x1876702246623104:12345-192.168.203.36@tcp:4:dd.500 Request processed in 8995us (48328us total) trans 4294967631 rc 0/0 00000100:00100000:2.0:1789762932.643237:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:2.0:1789762932.643293:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235071265025 time 235071438968 state 0x2 ref 0 00000100:00100000:0.0:1789762932.647427:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762932.647531:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246623232 00000100:00100000:1.0:1789762932.647561:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246623232 00000100:00100000:1.0:1789762932.647621:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235071265025 time 235071438968 state 0x0 ref 1 00000100:00100000:1.0:1789762932.647639:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235121438968 time 235071438968 state 0x1 ref 1 00000100:00100000:3.0:1789762932.684308:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235121438968 time 235121531392 state 0x0 ref 1 00000100:00100000:3.0:1789762932.684342:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246623232:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762932.684398:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 102760448, mtime: 0x6aad9d74, atime: 0x0, ctime: 0x6aad9d74, blocks: 0x31000 00010000:00010000:3.0:1789762932.684407:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.684425:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789762932.684438:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762932.684445:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.684460:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.690051:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967632 is committed 00002000:00010000:3.0:1789762932.690117:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:3.0:1789762932.690122:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 1789762932 -> 1789762933 00002000:00010000:3.0:1789762932.690124:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 1789762932 -> 1789762933 00002000:00010000:3.0:1789762932.690127:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 200704 -> 202752 00010000:00010000:3.0:1789762932.690138:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.690148:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.690156:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.690162:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.690166:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.690174:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.690200:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.690207:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5aebf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.690265:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246623232:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5935us (42843us total) trans 4294967632 rc 0/0 00000100:00100000:3.0:1789762932.690275:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:3.0:1789762932.690287:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235121438968 time 235121531392 state 0x2 ref 0 00000100:00100000:2.0:1789762932.693114:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762932.693226:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246623360 00000100:00100000:1.0:1789762932.693237:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246623360 00000100:00100000:1.0:1789762932.693284:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235121438968 time 235121531392 state 0x0 ref 1 00000100:00100000:1.0:1789762932.693298:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235171531392 time 235121531392 state 0x1 ref 1 00000100:00100000:1.0:1789762932.734382:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235171531392 time 235171612207 state 0x0 ref 1 00000100:00100000:1.0:1789762932.734407:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2354:x1876702246623360:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762932.734460:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 103809024, mtime: 0x6aad9d75, atime: 0x0, ctime: 0x6aad9d75, blocks: 0x31800 00010000:00010000:1.0:1789762932.734470:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.734487:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=235s v=(0 0) 00010000:00010000:1.0:1789762932.734493:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762932.734525:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.734566:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762932.742024:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967633 is committed 00002000:00010000:3.0:1789762932.742158:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:3.0:1789762932.742167:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 202752 -> 204800 00010000:00010000:3.0:1789762932.742182:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.742198:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.742210:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.742219:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da7e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762932.742225:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.742257:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.742279:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.742294:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd6e7f5b/0x5915dfb1c1b5aec6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762932.742407:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2354:x1876702246623360:12345-192.168.203.36@tcp:4:dd.500 Request processed in 8003us (49290us total) trans 4294967633 rc 0/0 00000100:00100000:3.0:1789762932.742433:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:3.0:1789762932.742448:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235171531392 time 235171612207 state 0x2 ref 0 00000100:00100000:1.0:1789762932.745163:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.745258:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246623616 00000100:00100000:2.0:1789762932.745272:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246623616 00000100:00100000:2.0:1789762932.745341:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:2.0:1789762932.745355:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:12361:x1876702246623616:12345-192.168.203.36@tcp:35:dd.500 00000001:00080000:2.0:1789762932.745579:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967437 00000100:00100000:2.0:1789762932.745742:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12361:x1876702246623616:12345-192.168.203.36@tcp:35:dd.500 Request processed in 387us (579us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789762932.745796:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000020:00080000:2.0:1789762932.745804:0:5927:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789762932.784121:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.784252:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246623744 00000100:00100000:2.0:1789762932.784265:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246623744 00000100:00100000:2.0:1789762932.784335:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:2.0:1789762932.784349:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:5431:x1876702246623744:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762932.784366:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00010000:00010000:2.0:1789762932.784406:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070d2c109/0x5915dfb1c1b5a9fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944791 expref: 12 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.784429:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078f2373d/0x5915dfb1c1b5aa04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 8 type: EXT [3145728->5242879] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944798 expref: 11 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.784441:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026118b18/0x5915dfb1c1b5aa27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789447bb expref: 10 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.784452:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5a9ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894478a expref: 9 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.784464:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5a9e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944783 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.784475:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db03643e/0x5915dfb1c1b5a9e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944775 expref: 7 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.784486:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aa0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894479f expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.784523:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762932.784579:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:5431:x1876702246623744:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 234us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762932.784599:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:0.0:1789762932.816884:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.817011:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624000 00000100:00100000:3.0:1789762932.817022:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624000 00000100:00100000:3.0:1789762932.817084:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:3.0:1789762932.817094:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12377:x1876702246624000:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762932.817118:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762932.817136:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5aecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944840 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.817256:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5aed4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.817298:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5aed4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.817315:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5aed4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762932.817329:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1d:0x0]: returning size 104857600 00010000:00010000:3.0:1789762932.817449:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460000/0x5915dfb1c1b5aecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944840 expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.817468:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5aed4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944840 expref: 12 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.817477:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9b33fec92800) 00010000:00010000:3.0:1789762932.817480:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789762932.817483:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461800, rc 0) 00000100:00100000:3.0:1789762932.817536:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12377:x1876702246624000:12345-192.168.203.36@tcp:101:dd.500 Request processed in 444us (663us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789762932.817544:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:1.0:1789762932.819496:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.819551:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624128 00000100:00100000:3.0:1789762932.819561:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624128 00000100:00100000:3.0:1789762932.819612:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:3.0:1789762932.819622:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246624128:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762932.819636:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762932.819652:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5aee2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944847 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762932.819734:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 104857600, mtime: 0x6aad9d75, atime: 0x0, ctime: 0x6aad9d75, blocks: 0x32000 00010000:00010000:3.0:1789762932.819751:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=235s v=(0 0) 00010000:00010000:3.0:1789762932.819756:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762932.819792:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5aee2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944847 expref: 6 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.819808:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5aee2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944847 expref: 6 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762932.819820:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461600, rc 0) 00000100:00100000:3.0:1789762932.819858:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246624128:12345-192.168.203.36@tcp:101:dd.500 Request processed in 238us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762932.819865:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:0.0:1789762932.823413:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762932.823495:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624256 00000100:00100000:2.0:1789762932.823505:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624256 00000100:00100000:2.0:1789762932.823564:0:12139:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 3 deadline 0 time 235260798312 state 0x0 ref 1 00000100:00100000:2.0:1789762932.823580:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 3 deadline 235360798312 time 235260798312 state 0x1 ref 1 00000100:00100000:2.0:1789762932.823629:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 2 deadline 235360798312 time 235260870735 state 0x0 ref 1 00000100:00100000:2.0:1789762932.823644:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624256:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762932.823708:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.823722:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.823726:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.823731:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.823742:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.828814:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.828845:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.828858:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.828869:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762932.828875:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.828889:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.828909:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.828919:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5aee9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.828993:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624256:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5349us (5580us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762932.829008:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:2.0:1789762932.829022:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 2 deadline 235360798312 time 235260870735 state 0x2 ref 0 00000100:00100000:2.0:1789762932.831442:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762932.831523:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624384 00000100:00100000:0.0:1789762932.831533:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624384 00000100:00100000:0.0:1789762932.831581:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 2 deadline 235360798312 time 235260870735 state 0x0 ref 1 00000100:00100000:0.0:1789762932.831600:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 2 deadline 235360870735 time 235260870735 state 0x1 ref 1 00000100:00100000:0.0:1789762932.831642:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 1 deadline 235360870735 time 235268881589 state 0x0 ref 1 00000100:00100000:0.0:1789762932.831680:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246624384:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762932.831707:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.831723:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762932.831729:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762932.831737:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.831808:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.835124:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.835144:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.835156:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.835166:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c5c35800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762932.835172:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.835184:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.835201:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762932.835211:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008756bfe3/0x5915dfb1c1b5aef0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762932.835283:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246624384:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3623us (3839us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762932.835304:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:0.0:1789762932.835317:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 1 deadline 235360870735 time 235268881589 state 0x2 ref 0 00000100:00100000:2.0:1789762932.837634:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762932.837723:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624512 00000100:00100000:1.0:1789762932.837734:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624512 00000100:00100000:1.0:1789762932.837795:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 1 deadline 235360870735 time 235268881589 state 0x0 ref 1 00000100:00100000:1.0:1789762932.837807:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 1 deadline 235368881589 time 235268881589 state 0x1 ref 1 00000100:00100000:1.0:1789762932.837836:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235368881589 time 235275079986 state 0x0 ref 1 00000100:00100000:1.0:1789762932.837848:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624512:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762932.837869:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.837881:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762932.837884:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762932.837889:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.837899:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.840478:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.840491:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.840498:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.840504:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9ffc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762932.840507:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.840514:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.840524:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762932.840530:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5aef7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762932.840589:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624512:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2742us (2956us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762932.840597:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:1.0:1789762932.840613:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235368881589 time 235275079986 state 0x2 ref 0 00000100:00100000:2.0:1789762932.842492:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.842538:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624640 00000100:00100000:3.0:1789762932.842545:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624640 00000100:00100000:3.0:1789762932.842575:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235368881589 time 235275079986 state 0x0 ref 1 00000100:00100000:3.0:1789762932.842585:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235375079986 time 235275079986 state 0x1 ref 1 00000100:00100000:2.0:1789762932.937930:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235375079986 time 235375161918 state 0x0 ref 1 00000100:00100000:2.0:1789762932.937956:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246624640:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762932.937991:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.938006:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.938009:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762932.938014:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.938025:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.940944:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.940954:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.940961:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.940966:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762932.940969:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.940985:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.940999:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762932.941004:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000149ba908/0x5915dfb1c1b5aefe lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762932.941052:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246624640:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3106us (98562us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762932.941059:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:2.0:1789762932.941067:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235375079986 time 235375161918 state 0x2 ref 0 00000100:00100000:2.0:1789762932.943620:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762932.943679:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624768 00000100:00100000:3.0:1789762932.943691:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624768 00000100:00100000:3.0:1789762932.943781:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235375079986 time 235375161918 state 0x0 ref 1 00000100:00100000:3.0:1789762932.943801:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235475161918 time 235375161918 state 0x1 ref 1 00000100:00100000:3.0:1789762933.038002:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235475161918 time 235475232896 state 0x0 ref 1 00000100:00100000:3.0:1789762933.038043:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624768:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:0.0:1789762933.038075:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762933.038080:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.038096:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.038099:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.038104:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.038114:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.040815:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.040830:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.040841:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.040850:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762933.040855:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.040874:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.040891:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.040901:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762933.040980:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624768:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2961us (97363us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762933.040990:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 109 00000100:00100000:3.0:1789762933.041002:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235475161918 time 235475232896 state 0x2 ref 0 00000100:00100000:0.0:1789762933.043478:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762933.043522:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246624896 00000100:00100000:1.0:1789762933.043531:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246624896 00000100:00100000:1.0:1789762933.043569:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235475161918 time 235475232896 state 0x0 ref 1 00000100:00100000:1.0:1789762933.043584:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235575232896 time 235475232896 state 0x1 ref 1 00000100:00100000:1.0:1789762933.138055:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235575232896 time 235575286721 state 0x0 ref 1 00000100:00100000:1.0:1789762933.138078:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624896:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762933.138123:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.138137:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762933.138141:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762933.138145:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.138156:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.140585:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.140596:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.140614:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.140620:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9ffc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762933.140623:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.140629:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.140642:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.140648:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020dca542/0x5915dfb1c1b5af0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762933.140732:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246624896:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2662us (97254us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762933.140739:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:1.0:1789762933.140747:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235575232896 time 235575286721 state 0x2 ref 0 00000100:00100000:3.0:1789762933.142637:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762933.142686:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625024 00000100:00100000:2.0:1789762933.142696:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625024 00000100:00100000:2.0:1789762933.142741:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235575232896 time 235575286721 state 0x0 ref 1 00000100:00100000:2.0:1789762933.142777:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235675286721 time 235575286721 state 0x1 ref 1 00000100:00100000:0.0:1789762933.238258:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235675286721 time 235675482390 state 0x0 ref 1 00000100:00100000:0.0:1789762933.238291:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246625024:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762933.238338:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.238358:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762933.238363:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762933.238371:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.238388:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.243412:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.243435:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.243472:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.243481:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffa29c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762933.243486:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.243497:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.243518:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.243528:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c3bf85f/0x5915dfb1c1b5af13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762933.243626:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246625024:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5345us (100985us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762933.243637:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:0.0:1789762933.243671:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235675286721 time 235675482390 state 0x2 ref 0 00000100:00100000:2.0:1789762933.247453:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762933.247519:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625152 00000100:00100000:3.0:1789762933.247532:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625152 00000100:00100000:3.0:1789762933.247587:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235675286721 time 235675482390 state 0x0 ref 1 00000100:00100000:3.0:1789762933.247604:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235775482390 time 235675482390 state 0x1 ref 1 00000100:00100000:3.0:1789762933.338337:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235775482390 time 235775562026 state 0x0 ref 1 00000100:00100000:3.0:1789762933.338370:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246625152:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762933.338432:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.338451:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.338455:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.338461:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.338476:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.342466:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.342484:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.342494:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.342502:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762933.342507:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.342516:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.342551:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.342559:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762933.342640:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246625152:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4282us (95188us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762933.342687:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:3.0:1789762933.342699:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235775482390 time 235775562026 state 0x2 ref 0 00000100:00100000:2.0:1789762933.345636:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762933.345741:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625280 00000100:00100000:1.0:1789762933.345779:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625280 00000100:00100000:1.0:1789762933.345830:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235775482390 time 235775562026 state 0x0 ref 1 00000100:00100000:1.0:1789762933.345858:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235875562026 time 235775562026 state 0x1 ref 1 00000100:00100000:3.0:1789762933.438522:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235875562026 time 235875734353 state 0x0 ref 1 00000100:00100000:3.0:1789762933.438569:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246625280:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762933.438684:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.438716:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.438725:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.438738:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.438801:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.445019:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.445039:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.445051:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.445060:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762933.445066:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.445078:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.445099:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.445110:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762933.445184:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246625280:12345-192.168.203.36@tcp:3:dd.500 Request processed in 6633us (99550us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762933.445198:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:3.0:1789762933.445222:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235875562026 time 235875734353 state 0x2 ref 0 00000100:00100000:2.0:1789762933.447980:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762933.448048:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625408 00000100:00100000:0.0:1789762933.448057:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625408 00000100:00100000:0.0:1789762933.448101:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235875562026 time 235875734353 state 0x0 ref 1 00000100:00100000:0.0:1789762933.448124:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235975734353 time 235875734353 state 0x1 ref 1 00000100:00100000:1.0:1789762933.538697:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235975734353 time 235975894749 state 0x0 ref 1 00000100:00100000:1.0:1789762933.538732:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246625408:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762933.538827:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.538849:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762933.538855:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762933.538863:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.538880:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.543819:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.543838:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.543849:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.543858:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4da6e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762933.543863:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.543874:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.543895:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.543903:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d937f7/0x5915dfb1c1b5af28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762933.543980:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246625408:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5260us (96000us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762933.543993:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:3.0:1789762933.544021:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235975734353 time 235975894749 state 0x2 ref 0 00000100:00100000:2.0:1789762933.547846:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762933.547913:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625536 00000100:00100000:3.0:1789762933.547926:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625536 00000100:00100000:3.0:1789762933.547980:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 235975734353 time 235975894749 state 0x0 ref 1 00000100:00100000:3.0:1789762933.547998:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236075894749 time 235975894749 state 0x1 ref 1 00010000:00010000:1.0:1789762933.626951:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762933.638848:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236075894749 time 236076072870 state 0x0 ref 1 00000100:00100000:2.0:1789762933.638887:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246625536:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762933.638941:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762933.638981:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762933.638987:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762933.638995:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762933.639012:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.643623:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.643645:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.643680:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.643691:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762933.643696:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.643708:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.643730:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.643740:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5af2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762933.643886:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246625536:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5013us (96040us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762933.643924:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:0.0:1789762933.643939:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236075894749 time 236076072870 state 0x2 ref 0 00000100:00100000:2.0:1789762933.647829:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762933.647919:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625664 00000100:00100000:3.0:1789762933.647936:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625664 00000100:00100000:3.0:1789762933.648003:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236075894749 time 236076072870 state 0x0 ref 1 00000100:00100000:3.0:1789762933.648022:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236176072870 time 236076072870 state 0x1 ref 1 00000100:00100000:3.0:1789762933.738954:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236176072870 time 236176174338 state 0x0 ref 1 00000100:00100000:3.0:1789762933.738991:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246625664:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762933.739045:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.739068:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.739074:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762933.739082:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.739100:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.744064:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.744085:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.744097:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.744106:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762933.744112:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.744124:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.744144:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762933.744153:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae96203a/0x5915dfb1c1b5af36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762933.744235:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246625664:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5256us (96409us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762933.744248:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:3.0:1789762933.744274:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236176072870 time 236176174338 state 0x2 ref 0 00000100:00100000:1.0:1789762933.748050:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762933.748117:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625792 00000100:00100000:3.0:1789762933.748131:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625792 00000100:00100000:3.0:1789762933.748191:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236176072870 time 236176174338 state 0x0 ref 1 00000100:00100000:3.0:1789762933.748211:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236276174338 time 236176174338 state 0x1 ref 1 00000100:00100000:1.0:1789762933.839167:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236276174338 time 236276389057 state 0x0 ref 1 00000100:00100000:1.0:1789762933.839203:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246625792:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762933.839276:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.839324:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762933.839330:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762933.839338:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.839357:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.844799:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.844819:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.844832:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.844843:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762933.844849:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.844861:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.844883:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762933.844913:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762933.844999:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246625792:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5808us (96950us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762933.845013:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:1.0:1789762933.845026:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236276174338 time 236276389057 state 0x2 ref 0 00000100:00100000:1.0:1789762933.848510:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762933.848676:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246625920 00000100:00100000:0.0:1789762933.848690:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246625920 00000100:00100000:0.0:1789762933.848798:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236276174338 time 236276389057 state 0x0 ref 1 00000100:00100000:0.0:1789762933.848820:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236376389057 time 236276389057 state 0x1 ref 1 00000100:00100000:0.0:1789762933.939275:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236376389057 time 236376496698 state 0x0 ref 1 00000100:00100000:0.0:1789762933.939313:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246625920:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762933.939369:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.939392:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762933.939398:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762933.939406:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.939425:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.944699:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.944746:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.944794:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.944805:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7acde00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762933.944811:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.944823:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.944844:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762933.944854:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccd85870/0x5915dfb1c1b5af44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762933.944942:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246625920:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5642us (96433us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762933.944954:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:0.0:1789762933.944968:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236376389057 time 236376496698 state 0x2 ref 0 00000100:00100000:2.0:1789762933.948498:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762933.948582:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626048 00000100:00100000:3.0:1789762933.948596:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626048 00000100:00100000:3.0:1789762933.948691:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236376389057 time 236376496698 state 0x0 ref 1 00000100:00100000:3.0:1789762933.948720:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236476496698 time 236376496698 state 0x1 ref 1 00000100:00100000:1.0:1789762934.039525:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236476496698 time 236476746447 state 0x0 ref 1 00000100:00100000:1.0:1789762934.039561:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626048:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762934.039618:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.039641:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.039675:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.039684:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.039703:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.044826:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.044860:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.044873:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.044883:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762934.044888:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.044900:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.044922:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.044931:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762934.045020:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626048:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5470us (96523us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762934.045032:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:1.0:1789762934.045046:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236476496698 time 236476746447 state 0x2 ref 0 00000100:00100000:3.0:1789762934.048710:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762934.048841:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626176 00000100:00100000:1.0:1789762934.048871:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626176 00000100:00100000:1.0:1789762934.048955:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236476496698 time 236476746447 state 0x0 ref 1 00000100:00100000:1.0:1789762934.048986:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236576746447 time 236476746447 state 0x1 ref 1 00000100:00100000:3.0:1789762934.139666:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236576746447 time 236576865862 state 0x0 ref 1 00000100:00100000:3.0:1789762934.139708:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626176:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762934.139799:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.139823:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762934.139829:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762934.139837:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.139884:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.145229:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.145257:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.145271:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.145281:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762934.145287:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.145299:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.145321:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.145332:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762934.145436:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626176:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5742us (96731us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762934.145449:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:3.0:1789762934.145464:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236576746447 time 236576865862 state 0x2 ref 0 00000100:00100000:3.0:1789762934.148939:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762934.149019:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626304 00000100:00100000:0.0:1789762934.149044:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626304 00000100:00100000:0.0:1789762934.149102:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236576746447 time 236576865862 state 0x0 ref 1 00000100:00100000:0.0:1789762934.149120:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236676865862 time 236576865862 state 0x1 ref 1 00000100:00100000:3.0:1789762934.239822:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236676865862 time 236677044527 state 0x0 ref 1 00000100:00100000:3.0:1789762934.239856:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626304:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762934.239910:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.239933:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762934.239939:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762934.239947:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.239965:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.245230:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.245251:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.245414:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.245431:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f6400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762934.245441:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.245463:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.245495:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.245506:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d365a08/0x5915dfb1c1b5af59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762934.245592:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626304:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5745us (96653us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762934.245604:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:3.0:1789762934.245617:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236676865862 time 236677044527 state 0x2 ref 0 00000100:00100000:3.0:1789762934.249301:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762934.249383:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626432 00000100:00100000:1.0:1789762934.249397:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626432 00000100:00100000:1.0:1789762934.249460:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236676865862 time 236677044527 state 0x0 ref 1 00000100:00100000:1.0:1789762934.249478:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236777044527 time 236677044527 state 0x1 ref 1 00000100:00100000:0.0:1789762934.339981:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236777044527 time 236777202085 state 0x0 ref 1 00000100:00100000:0.0:1789762934.340019:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626432:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762934.340074:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.340098:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762934.340104:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762934.340112:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.340130:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762934.345460:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762934.345482:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762934.345496:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762934.345506:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7bfce00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762934.345512:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762934.345539:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762934.345562:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762934.345572:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057026d5c/0x5915dfb1c1b5af60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762934.345678:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626432:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5672us (96377us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762934.345692:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:2.0:1789762934.345705:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236777044527 time 236777202085 state 0x2 ref 0 00000100:00100000:0.0:1789762934.349365:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762934.349465:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626560 00000100:00100000:3.0:1789762934.349492:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626560 00000100:00100000:3.0:1789762934.349566:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236777044527 time 236777202085 state 0x0 ref 1 00000100:00100000:3.0:1789762934.349610:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236877202085 time 236777202085 state 0x1 ref 1 00000100:00100000:1.0:1789762934.440167:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236877202085 time 236877381877 state 0x0 ref 1 00000100:00100000:1.0:1789762934.440215:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626560:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762934.440271:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.440294:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.440301:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.440309:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.440327:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.445485:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.445532:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.445545:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.445554:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762934.445560:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.445572:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.445594:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.445604:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5af67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762934.445713:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626560:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5515us (96348us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762934.445727:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:1.0:1789762934.445740:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236877202085 time 236877381877 state 0x2 ref 0 00000100:00100000:1.0:1789762934.449257:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762934.449374:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626688 00000100:00100000:3.0:1789762934.449389:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626688 00000100:00100000:3.0:1789762934.449451:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236877202085 time 236877381877 state 0x0 ref 1 00000100:00100000:3.0:1789762934.449471:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236977381877 time 236877381877 state 0x1 ref 1 00000100:00100000:3.0:1789762934.540301:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236977381877 time 236977514815 state 0x0 ref 1 00000100:00100000:3.0:1789762934.540346:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626688:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762934.540402:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.540425:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762934.540431:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762934.540440:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.540458:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.546887:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.546928:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.546939:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.546947:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffb01200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762934.546952:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.546963:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.546985:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.546993:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762934.547120:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626688:12345-192.168.203.36@tcp:3:dd.500 Request processed in 6782us (97858us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762934.547162:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:3.0:1789762934.547182:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236977381877 time 236977514815 state 0x2 ref 0 00000100:00100000:3.0:1789762934.550677:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762934.550790:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626816 00000100:00100000:2.0:1789762934.550803:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626816 00000100:00100000:2.0:1789762934.550864:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 236977381877 time 236977514815 state 0x0 ref 1 00000100:00100000:2.0:1789762934.550882:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237077514815 time 236977514815 state 0x1 ref 1 00000100:00100000:3.0:1789762934.640512:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237077514815 time 237077735050 state 0x0 ref 1 00000100:00100000:3.0:1789762934.640550:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626816:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762934.640604:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.640627:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762934.640633:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762934.640668:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.640691:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.645599:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.645621:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.645634:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.645671:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffb01200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762934.645681:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.645730:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.645801:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.645819:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7ca3921/0x5915dfb1c1b5af75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762934.645924:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246626816:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5383us (95243us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762934.645940:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:3.0:1789762934.645955:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237077514815 time 237077735050 state 0x2 ref 0 00000100:00100000:3.0:1789762934.649461:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762934.649595:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246626944 00000100:00100000:1.0:1789762934.649609:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246626944 00000100:00100000:1.0:1789762934.649704:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237077514815 time 237077735050 state 0x0 ref 1 00000100:00100000:1.0:1789762934.649725:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237177735050 time 237077735050 state 0x1 ref 1 00010000:00010000:0.0:1789762934.651049:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762934.740616:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237177735050 time 237177837572 state 0x0 ref 1 00000100:00100000:1.0:1789762934.740678:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626944:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762934.740733:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.740794:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.740801:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.740811:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.740829:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.745280:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.745302:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.745315:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.745326:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7afec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762934.745346:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.745359:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.745382:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762934.745392:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033702a44/0x5915dfb1c1b5af7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762934.745493:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246626944:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4849us (96029us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762934.745512:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:3.0:1789762934.745530:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237177735050 time 237177837572 state 0x2 ref 0 00000100:00100000:3.0:1789762934.748977:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762934.749062:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627072 00000100:00100000:1.0:1789762934.749076:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627072 00000100:00100000:1.0:1789762934.749135:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237177735050 time 237177837572 state 0x0 ref 1 00000100:00100000:1.0:1789762934.749159:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237277837572 time 237177837572 state 0x1 ref 1 00000100:00100000:0.0:1789762934.840836:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237277837572 time 237278057007 state 0x0 ref 1 00000100:00100000:0.0:1789762934.840873:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627072:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762934.840929:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.840970:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762934.840977:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762934.840985:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.841003:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.845699:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.845732:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.845746:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.845791:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7acd000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762934.845797:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.845809:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.845831:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762934.845861:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000743f3880/0x5915dfb1c1b5af83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762934.845951:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627072:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5088us (96971us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762934.845970:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:0.0:1789762934.845988:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237277837572 time 237278057007 state 0x2 ref 0 00000100:00100000:0.0:1789762934.849490:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762934.849566:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627200 00000100:00100000:3.0:1789762934.849580:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627200 00000100:00100000:3.0:1789762934.849661:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237277837572 time 237278057007 state 0x0 ref 1 00000100:00100000:3.0:1789762934.849683:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237378057007 time 237278057007 state 0x1 ref 1 00000100:00100000:1.0:1789762934.941026:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237378057007 time 237378242749 state 0x0 ref 1 00000100:00100000:1.0:1789762934.941066:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627200:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762934.941120:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.941143:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.941150:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762934.941157:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.941175:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.945705:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.945725:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.945738:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.945779:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762934.945787:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.945820:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.945843:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762934.945854:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5af8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762934.945936:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627200:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4885us (96448us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762934.945949:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:1.0:1789762934.945963:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237378057007 time 237378242749 state 0x2 ref 0 00000100:00100000:1.0:1789762934.949533:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762934.949610:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627328 00000100:00100000:3.0:1789762934.949624:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627328 00000100:00100000:3.0:1789762934.949703:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237378057007 time 237378242749 state 0x0 ref 1 00000100:00100000:3.0:1789762934.949734:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237478242749 time 237378242749 state 0x1 ref 1 00000100:00100000:2.0:1789762935.041190:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237478242749 time 237478411377 state 0x0 ref 1 00000100:00100000:2.0:1789762935.041252:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627328:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:0.0:1789762935.041309:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762935.041311:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.041353:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.041359:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.041369:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.041387:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.045722:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.045742:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.045784:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.045795:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762935.045801:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.045813:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.045833:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.045864:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762935.045947:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627328:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4732us (96416us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762935.045959:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:2.0:1789762935.045972:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237478242749 time 237478411377 state 0x2 ref 0 00000100:00100000:3.0:1789762935.049998:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762935.050075:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627456 00000100:00100000:0.0:1789762935.050089:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627456 00000100:00100000:0.0:1789762935.050164:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237478242749 time 237478411377 state 0x0 ref 1 00000100:00100000:0.0:1789762935.050184:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237578411377 time 237478411377 state 0x1 ref 1 00000100:00100000:2.0:1789762935.141399:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237578411377 time 237578620042 state 0x0 ref 1 00000100:00100000:2.0:1789762935.141434:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627456:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762935.141488:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.141511:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.141517:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.141525:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.141544:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.146696:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.146795:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.146811:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.146820:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762935.146826:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.146838:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.146859:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.146869:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5af98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762935.146961:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627456:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5534us (96962us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762935.146979:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 130 00000100:00100000:2.0:1789762935.146998:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237578411377 time 237578620042 state 0x2 ref 0 00000100:00100000:1.0:1789762935.150580:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762935.150685:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627584 00000100:00100000:3.0:1789762935.150699:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627584 00000100:00100000:3.0:1789762935.150817:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237578411377 time 237578620042 state 0x0 ref 1 00000100:00100000:3.0:1789762935.150848:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237678620042 time 237578620042 state 0x1 ref 1 00000100:00100000:1.0:1789762935.241622:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237678620042 time 237678836177 state 0x0 ref 1 00000100:00100000:1.0:1789762935.241692:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627584:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762935.241798:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.241822:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762935.241828:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762935.241857:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.241876:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.247257:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.247277:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.247290:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.247299:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762935.247305:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.247316:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.247337:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.247360:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3877a6c/0x5915dfb1c1b5af9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762935.247443:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627584:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5772us (96867us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762935.247456:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:3.0:1789762935.247469:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237678620042 time 237678836177 state 0x2 ref 0 00000100:00100000:3.0:1789762935.251203:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762935.251301:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627712 00000100:00100000:2.0:1789762935.251326:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627712 00000100:00100000:2.0:1789762935.251387:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237678620042 time 237678836177 state 0x0 ref 1 00000100:00100000:2.0:1789762935.251406:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237778836177 time 237678836177 state 0x1 ref 1 00000100:00100000:3.0:1789762935.341798:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237778836177 time 237778993022 state 0x0 ref 1 00000100:00100000:3.0:1789762935.341834:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627712:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762935.341889:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.341912:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762935.341919:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762935.341927:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.341946:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.346738:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.346797:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.346811:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.346820:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7aff000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762935.346826:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.346838:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.346859:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.346868:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afa6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762935.346951:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627712:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5129us (95752us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762935.346964:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:3.0:1789762935.346978:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237778836177 time 237778993022 state 0x2 ref 0 00000100:00100000:3.0:1789762935.350621:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762935.350801:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627840 00000100:00100000:2.0:1789762935.350816:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627840 00000100:00100000:2.0:1789762935.350878:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237778836177 time 237778993022 state 0x0 ref 1 00000100:00100000:2.0:1789762935.350898:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237878993022 time 237778993022 state 0x1 ref 1 00000100:00100000:1.0:1789762935.441987:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237878993022 time 237879208688 state 0x0 ref 1 00000100:00100000:1.0:1789762935.442023:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627840:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762935.442080:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.442103:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762935.442109:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762935.442117:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.442136:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.447063:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.447087:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.447106:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.447122:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33d1693000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762935.447131:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.447151:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.447184:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.447196:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afad lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762935.447283:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246627840:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5271us (96663us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762935.447301:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 133 00000100:00100000:3.0:1789762935.447320:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237878993022 time 237879208688 state 0x2 ref 0 00000100:00100000:3.0:1789762935.450828:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762935.450935:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246627968 00000100:00100000:1.0:1789762935.450949:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246627968 00000100:00100000:1.0:1789762935.451007:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237878993022 time 237879208688 state 0x0 ref 1 00000100:00100000:1.0:1789762935.451026:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237979208688 time 237879208688 state 0x1 ref 1 00000100:00100000:0.0:1789762935.542164:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237979208688 time 237979385403 state 0x0 ref 1 00000100:00100000:0.0:1789762935.542217:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627968:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762935.542270:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762935.542292:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762935.542298:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762935.542325:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762935.542345:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.547452:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.547474:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.547487:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.547498:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f75f1e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762935.547503:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.547515:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.547562:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.547579:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064075df3/0x5915dfb1c1b5afb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762935.547706:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246627968:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5516us (96877us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762935.547719:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 134 00000100:00100000:2.0:1789762935.547732:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237979208688 time 237979385403 state 0x2 ref 0 00000100:00100000:3.0:1789762935.551421:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762935.551510:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628096 00000100:00100000:0.0:1789762935.551524:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628096 00000100:00100000:0.0:1789762935.551598:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 237979208688 time 237979385403 state 0x0 ref 1 00000100:00100000:0.0:1789762935.551618:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238079385403 time 237979385403 state 0x1 ref 1 00000100:00100000:0.0:1789762935.611003:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254928896:0@lo:400:kworker.0 00000100:00100000:2.0:1789762935.611066:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254929024:0@lo:400:kworker.0 00000100:00100000:3.0:1789762935.611080:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254928768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762935.611113:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254928640:0@lo:400:kworker.0 00000100:00100000:0.0:1789762935.611116:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762935.611185:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762935.611201:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762935.611240:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254929408:0@lo:400:kworker.0 00000100:00100000:1.0:1789762935.611289:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762935.611300:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254929280:0@lo:400:kworker.0 00000100:00100000:0.0:1789762935.611319:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762935.611336:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254928896 00000100:00100000:2.0:1789762935.611351:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254928896 00000100:00100000:3.0:1789762935.611390:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762935.611440:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c211ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254929152:0@lo:400:kworker.0 00000100:00100000:2.0:1789762935.611444:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929024 00000100:00100000:2.0:1789762935.611454:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929024 00000100:00100000:0.0:1789762935.611472:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929280 00000100:00100000:3.0:1789762935.611482:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254928768 00000100:00100000:0.0:1789762935.611483:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929280 00000100:00100000:3.0:1789762935.611500:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254928768 00000100:00100000:2.0:1789762935.611526:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789762935.611550:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762935.611554:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254928896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762935.611590:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789762935.611600:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789762935.611615:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254928768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762935.611628:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254929024:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789762935.611686:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 24519232 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762935.611695:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254928640 00000100:00100000:2.0:1789762935.611696:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1876702254928896:12345-0@lo:400:kworker.0 Request processed in 149us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762935.611710:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254928640 00000100:00100000:2.0:1789762935.611719:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789762935.611799:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1876702254929024:12345-0@lo:400:kworker.0 Request processed in 136us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762935.611814:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789762935.611825:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254928768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762935.611835:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789762935.611840:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254929280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762935.611852:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789762935.611864:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789762935.611896:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929408 00000100:00100000:1.0:1789762935.611902:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254928640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762935.611905:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929408 00000100:00100000:3.0:1789762935.611960:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254928768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762935.611968:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929152 00000100:00100000:2.0:1789762935.611970:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1876702254929280:12345-0@lo:400:kworker.0 Request processed in 132us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762935.611980:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929152 00000100:00100000:2.0:1789762935.611989:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789762935.612000:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1876702254929280:0@lo:400:kworker.0 00000100:00100000:1.0:1789762935.612042:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254928640:12345-0@lo:400:kworker.0 Request processed in 148us (758us total) trans 0 rc 0/0 00000100:00080000:2.0:1789762935.612057:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762935.612069:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789762935.612069:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762935.612070:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789762935.612080:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762935.612090:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789762935.612100:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3420:x1876702254929408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762935.612119:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254929152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762935.612151:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1876702254928896:0@lo:400:kworker.0 00000100:00100000:0.0:1789762935.612195:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3420:x1876702254929408:12345-0@lo:400:kworker.0 Request processed in 104us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762935.612208:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789762935.612217:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254928640:0@lo:400:kworker.0 00000100:00100000:2.0:1789762935.612227:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254929408:0@lo:400:kworker.0 00000100:00100000:3.0:1789762935.612243:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254929152:12345-0@lo:400:kworker.0 Request processed in 126us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762935.612263:0:3418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967629 gen 2 00000100:00100000:3.0:1789762935.612264:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000004:00080000:1.0:1789762935.612278:0:3418:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c6cfb100, transno 4294967629 00000100:00100000:0.0:1789762935.612294:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1876702254929024:0@lo:400:kworker.0 00000100:00100000:1.0:1789762935.612305:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c211ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254929152:0@lo:400:kworker.0 00000100:00100000:3.0:1789762935.642335:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238079385403 time 238079563621 state 0x0 ref 1 00000100:00100000:3.0:1789762935.642363:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628096:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762935.642420:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.642443:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762935.642449:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762935.642457:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.642477:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.647280:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.647301:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.647313:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.647323:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7aff000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762935.647329:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.647340:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.647382:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.647392:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d105d876/0x5915dfb1c1b5afbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762935.647468:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628096:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5111us (96049us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762935.647479:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 135 00000100:00100000:3.0:1789762935.647491:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238079385403 time 238079563621 state 0x2 ref 0 00000100:00100000:3.0:1789762935.651105:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762935.651246:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628224 00000100:00100000:1.0:1789762935.651259:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628224 00000100:00100000:1.0:1789762935.651317:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238079385403 time 238079563621 state 0x0 ref 1 00000100:00100000:1.0:1789762935.651337:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238179563621 time 238079563621 state 0x1 ref 1 00010000:00010000:1.0:1789762935.675015:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762935.742527:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238179563621 time 238179748486 state 0x0 ref 1 00000100:00100000:2.0:1789762935.742566:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246628224:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762935.742620:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.742667:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.742673:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.742682:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.742702:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.747699:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.747726:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.747800:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.747811:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762935.747818:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.747830:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.747852:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.747862:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762935.747959:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246628224:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5407us (96855us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762935.747971:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:2.0:1789762935.747984:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238179563621 time 238179748486 state 0x2 ref 0 00000100:00100000:0.0:1789762935.751525:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762935.751669:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628352 00000100:00100000:2.0:1789762935.751683:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628352 00000100:00100000:2.0:1789762935.751743:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238179563621 time 238179748486 state 0x0 ref 1 00000100:00100000:2.0:1789762935.751815:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238279748486 time 238179748486 state 0x1 ref 1 00000100:00100000:2.0:1789762935.842660:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238279748486 time 238279856734 state 0x0 ref 1 00000100:00100000:2.0:1789762935.842702:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628352:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762935.842800:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.842824:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.842830:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762935.842838:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.842857:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.847221:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.847243:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.847256:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.847290:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762935.847298:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.847310:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.847334:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762935.847344:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5afc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762935.847430:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628352:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4742us (95906us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762935.847443:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:2.0:1789762935.847456:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238279748486 time 238279856734 state 0x2 ref 0 00000100:00100000:1.0:1789762935.851377:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762935.851461:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628480 00000100:00100000:3.0:1789762935.851475:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628480 00000100:00100000:3.0:1789762935.851535:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238279748486 time 238279856734 state 0x0 ref 1 00000100:00100000:3.0:1789762935.851554:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238379856734 time 238279856734 state 0x1 ref 1 00000100:00100000:3.0:1789762935.942813:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238379856734 time 238380035309 state 0x0 ref 1 00000100:00100000:3.0:1789762935.942851:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246628480:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762935.942905:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.942954:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762935.942961:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762935.942969:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762935.942988:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.951996:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.952051:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.952071:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.952086:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c6026400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762935.952096:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.952114:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.952158:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762935.952175:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee888c8f/0x5915dfb1c1b5afd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762935.952308:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246628480:12345-192.168.203.36@tcp:3:dd.500 Request processed in 9465us (100927us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762935.952329:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 138 00000100:00100000:1.0:1789762935.952353:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238379856734 time 238380035309 state 0x2 ref 0 00000100:00100000:1.0:1789762935.956268:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762935.956376:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628608 00000100:00100000:2.0:1789762935.956392:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628608 00000100:00100000:2.0:1789762935.956467:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238379856734 time 238380035309 state 0x0 ref 1 00000100:00100000:2.0:1789762935.956496:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238480035309 time 238380035309 state 0x1 ref 1 00000100:00100000:0.0:1789762936.042961:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238480035309 time 238480182928 state 0x0 ref 1 00000100:00100000:0.0:1789762936.042998:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628608:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762936.043050:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762936.043073:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762936.043094:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762936.043104:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762936.043122:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.049949:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.049973:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.049986:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.049996:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f757c400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762936.050002:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.050014:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.050036:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.050065:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb590db/0x5915dfb1c1b5afd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762936.050156:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628608:12345-192.168.203.36@tcp:3:dd.500 Request processed in 7169us (93888us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762936.050170:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 139 00000100:00100000:3.0:1789762936.050184:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238480035309 time 238480182928 state 0x2 ref 0 00000100:00100000:1.0:1789762936.053939:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762936.054028:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628736 00000100:00100000:2.0:1789762936.054052:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628736 00000100:00100000:2.0:1789762936.054110:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238480035309 time 238480182928 state 0x0 ref 1 00000100:00100000:2.0:1789762936.054130:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238580182928 time 238480182928 state 0x1 ref 1 00000100:00100000:1.0:1789762936.143123:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238580182928 time 238580344810 state 0x0 ref 1 00000100:00100000:1.0:1789762936.143160:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628736:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762936.143218:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.143249:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762936.143258:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762936.143270:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.143298:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.148486:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.148506:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.148519:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.148529:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33d1693000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762936.148535:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.148546:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.148568:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.148592:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006651f400/0x5915dfb1c1b5afde lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762936.148693:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246628736:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5545us (94755us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762936.148706:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 140 00000100:00100000:3.0:1789762936.148721:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238580182928 time 238580344810 state 0x2 ref 0 00000100:00100000:0.0:1789762936.152307:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762936.152393:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628864 00000100:00100000:1.0:1789762936.152406:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628864 00000100:00100000:1.0:1789762936.152463:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238580182928 time 238580344810 state 0x0 ref 1 00000100:00100000:1.0:1789762936.152483:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238680344810 time 238580344810 state 0x1 ref 1 00000100:00100000:1.0:1789762936.196267:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762936.196351:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762936.196386:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246629120 00000100:00100000:0.0:1789762936.196402:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246629120 00000100:00100000:1.0:1789762936.196431:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762936.196501:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762936.196535:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246628992 00000100:00100000:0.0:1789762936.196545:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246629376 00000100:00100000:3.0:1789762936.196548:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246629248 00000100:00100000:2.0:1789762936.196549:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246628992 00000100:00100000:0.0:1789762936.196556:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246629376 00000100:00100000:3.0:1789762936.196562:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246629248 00000100:00100000:1.0:1789762936.196602:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:1.0:1789762936.196664:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2355:x1876702246629120:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762936.196676:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 267 00000100:00100000:3.0:1789762936.196684:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:0.0:1789762936.196695:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 152 00000100:00100000:2.0:1789762936.196706:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246628992:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762936.196717:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246629248:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762936.196726:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246629376:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762936.196866:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2355:x1876702246629120:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 220us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762936.196867:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246628992:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 155us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762936.196868:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246629248:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762936.196886:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246629376:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 165us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762936.196908:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:3.0:1789762936.196924:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:2.0:1789762936.196925:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 267 00000100:00100000:0.0:1789762936.196926:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 152 00000100:00080000:3.0:1789762936.197029:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762936.197042:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762936.243319:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238680344810 time 238680543288 state 0x0 ref 1 00000100:00100000:0.0:1789762936.243366:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246628864:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762936.243418:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762936.243441:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762936.243447:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762936.243456:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762936.243474:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.248306:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.248336:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.248355:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.248365:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762936.248372:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.248383:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.248428:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.248438:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000659322f1/0x5915dfb1c1b5afe5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762936.248521:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246628864:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5179us (96216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762936.248533:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:2.0:1789762936.248547:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238680344810 time 238680543288 state 0x2 ref 0 00000100:00100000:1.0:1789762936.252570:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762936.252697:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246629504 00000100:00100000:3.0:1789762936.252715:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246629504 00000100:00100000:3.0:1789762936.252833:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238680344810 time 238680543288 state 0x0 ref 1 00000100:00100000:3.0:1789762936.252859:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238780543288 time 238680543288 state 0x1 ref 1 00000100:00100000:3.0:1789762936.343425:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238780543288 time 238780645956 state 0x0 ref 1 00000100:00100000:3.0:1789762936.343481:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246629504:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762936.343537:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.343561:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762936.343567:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762936.343575:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.343593:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.348652:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.348676:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.348689:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.348699:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f79d0a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762936.348705:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.348718:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.348784:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.348796:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5afec lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762936.348878:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246629504:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5405us (96310us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762936.348890:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:3.0:1789762936.348903:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238780543288 time 238780645956 state 0x2 ref 0 00000100:00100000:3.0:1789762936.352493:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762936.352580:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246629632 00000100:00100000:1.0:1789762936.352595:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246629632 00000100:00100000:1.0:1789762936.352698:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238780543288 time 238780645956 state 0x0 ref 1 00000100:00100000:1.0:1789762936.352728:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238880645956 time 238780645956 state 0x1 ref 1 00000100:00100000:2.0:1789762936.443686:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238880645956 time 238880908461 state 0x0 ref 1 00000100:00100000:2.0:1789762936.443722:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246629632:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762936.443847:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.443873:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762936.443879:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762936.443887:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.443925:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.449006:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.449034:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.449053:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.449069:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762936.449076:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.449093:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.449121:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.449139:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5aff3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762936.449246:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246629632:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5533us (96752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762936.449259:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 143 00000100:00100000:2.0:1789762936.449286:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238880645956 time 238880908461 state 0x2 ref 0 00000100:00100000:3.0:1789762936.453232:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762936.453316:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246629760 00000100:00100000:2.0:1789762936.453330:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246629760 00000100:00100000:2.0:1789762936.453387:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238880645956 time 238880908461 state 0x0 ref 1 00000100:00100000:2.0:1789762936.453406:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238980908461 time 238880908461 state 0x1 ref 1 00000100:00100000:2.0:1789762936.543837:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238980908461 time 238981059240 state 0x0 ref 1 00000100:00100000:2.0:1789762936.543875:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246629760:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762936.543929:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.543952:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762936.543958:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762936.543966:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.543984:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.549096:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.549116:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.549146:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.549156:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762936.549162:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.549173:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.549195:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.549204:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5affa lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762936.549292:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246629760:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5428us (96061us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762936.549304:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 144 00000100:00100000:2.0:1789762936.549318:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238980908461 time 238981059240 state 0x2 ref 0 00000100:00100000:3.0:1789762936.552975:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762936.553062:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246629888 00000100:00100000:1.0:1789762936.553077:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246629888 00000100:00100000:1.0:1789762936.553154:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 238980908461 time 238981059240 state 0x0 ref 1 00000100:00100000:1.0:1789762936.553173:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239081059240 time 238981059240 state 0x1 ref 1 00000100:00100000:1.0:1789762936.643963:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239081059240 time 239081173545 state 0x0 ref 1 00000100:00100000:1.0:1789762936.643998:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246629888:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762936.644051:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.644074:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762936.644081:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762936.644108:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.644130:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.648663:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.648683:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.648696:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.648705:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762936.648711:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.648722:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.648744:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762936.648785:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b001 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762936.648892:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246629888:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4905us (95919us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762936.648906:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 145 00000100:00100000:1.0:1789762936.648920:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239081059240 time 239081173545 state 0x2 ref 0 00000100:00100000:3.0:1789762936.652704:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762936.652801:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630016 00000100:00100000:2.0:1789762936.652815:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630016 00000100:00100000:2.0:1789762936.652874:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239081059240 time 239081173545 state 0x0 ref 1 00000100:00100000:2.0:1789762936.652911:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239181173545 time 239081173545 state 0x1 ref 1 00010000:00010000:0.0:1789762936.699031:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762936.744091:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239181173545 time 239181308597 state 0x0 ref 1 00000100:00100000:3.0:1789762936.744157:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630016:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762936.744216:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.744239:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762936.744246:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762936.744256:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.744320:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.749101:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.749122:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.749136:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.749145:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f79d0a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762936.749151:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.749162:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.749184:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.749193:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b008 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762936.749302:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630016:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5179us (96596us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762936.749320:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:3.0:1789762936.749339:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239181173545 time 239181308597 state 0x2 ref 0 00000100:00100000:3.0:1789762936.752993:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762936.753071:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630144 00000100:00100000:2.0:1789762936.753085:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630144 00000100:00100000:2.0:1789762936.753146:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239181173545 time 239181308597 state 0x0 ref 1 00000100:00100000:2.0:1789762936.753165:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239281308597 time 239181308597 state 0x1 ref 1 00000100:00100000:3.0:1789762936.844263:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239281308597 time 239281477532 state 0x0 ref 1 00000100:00100000:3.0:1789762936.844311:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630144:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762936.844370:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.844394:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762936.844400:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762936.844408:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.844443:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.850827:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.850857:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.850892:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.850908:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f79d0a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762936.850918:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.850938:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.850963:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762936.850974:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b00f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762936.851059:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630144:12345-192.168.203.36@tcp:3:dd.500 Request processed in 6765us (98067us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762936.851073:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:3.0:1789762936.851094:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239281308597 time 239281477532 state 0x2 ref 0 00000100:00100000:3.0:1789762936.854933:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762936.855042:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630272 00000100:00100000:1.0:1789762936.855057:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630272 00000100:00100000:1.0:1789762936.855134:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239281308597 time 239281477532 state 0x0 ref 1 00000100:00100000:1.0:1789762936.855153:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239381477532 time 239281477532 state 0x1 ref 1 00000100:00100000:0.0:1789762936.944437:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239381477532 time 239381657703 state 0x0 ref 1 00000100:00100000:0.0:1789762936.944474:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246630272:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762936.944530:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762936.944580:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762936.944587:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762936.944595:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762936.944614:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.949970:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.949996:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.950008:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.950018:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f77ecc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762936.950024:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.950036:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.950058:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762936.950081:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f111c4c9/0x5915dfb1c1b5b016 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762936.950179:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246630272:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5713us (95244us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762936.950198:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 148 00000100:00100000:2.0:1789762936.950218:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239381477532 time 239381657703 state 0x2 ref 0 00000100:00100000:3.0:1789762936.953695:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762936.953791:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630400 00000100:00100000:0.0:1789762936.953806:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630400 00000100:00100000:0.0:1789762936.953871:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239381477532 time 239381657703 state 0x0 ref 1 00000100:00100000:0.0:1789762936.953890:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239481657703 time 239381657703 state 0x1 ref 1 00000100:00100000:1.0:1789762937.044665:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239481657703 time 239481863242 state 0x0 ref 1 00000100:00100000:1.0:1789762937.044728:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246630400:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:3.0:1789762937.044796:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762937.044843:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.044869:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762937.044875:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762937.044883:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.044901:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.049203:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.049244:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.049264:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.049280:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffca5000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762937.049289:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.049309:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.049339:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.049350:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015e9ca3d/0x5915dfb1c1b5b01d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762937.049440:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246630400:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4749us (95749us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762937.049452:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 149 00000100:00100000:3.0:1789762937.049466:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239481657703 time 239481863242 state 0x2 ref 0 00000100:00100000:3.0:1789762937.053053:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762937.053162:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630528 00000100:00100000:1.0:1789762937.053191:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630528 00000100:00100000:1.0:1789762937.053252:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239481657703 time 239481863242 state 0x0 ref 1 00000100:00100000:1.0:1789762937.053271:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239581863242 time 239481863242 state 0x1 ref 1 00000100:00100000:2.0:1789762937.144869:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239581863242 time 239582083127 state 0x0 ref 1 00000100:00100000:2.0:1789762937.144916:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246630528:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762937.144984:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.145084:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.145094:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.145107:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.145135:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.151281:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.151330:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.151344:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.151354:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762937.151360:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.151372:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.151396:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.151407:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b024 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762937.151514:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246630528:12345-192.168.203.36@tcp:3:dd.500 Request processed in 6609us (98456us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762937.151549:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 150 00000100:00100000:2.0:1789762937.151569:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239581863242 time 239582083127 state 0x2 ref 0 00000100:00100000:3.0:1789762937.155291:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762937.155358:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630656 00000100:00100000:2.0:1789762937.155384:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630656 00000100:00100000:2.0:1789762937.155444:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239581863242 time 239582083127 state 0x0 ref 1 00000100:00100000:2.0:1789762937.155463:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239682083127 time 239582083127 state 0x1 ref 1 00000100:00100000:2.0:1789762937.244983:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239682083127 time 239682203742 state 0x0 ref 1 00000100:00100000:2.0:1789762937.245025:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246630656:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762937.245108:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.245139:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.245145:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.245154:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.245173:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.251052:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.251074:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.251087:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.251124:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762937.251133:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.251151:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.251184:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.251199:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b02b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762937.251290:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246630656:12345-192.168.203.36@tcp:3:dd.500 Request processed in 6280us (96001us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762937.251311:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:2.0:1789762937.251332:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239682083127 time 239682203742 state 0x2 ref 0 00000100:00100000:3.0:1789762937.255107:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762937.255214:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630784 00000100:00100000:1.0:1789762937.255228:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630784 00000100:00100000:1.0:1789762937.255288:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239682083127 time 239682203742 state 0x0 ref 1 00000100:00100000:1.0:1789762937.255308:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239782203742 time 239682203742 state 0x1 ref 1 00000100:00100000:3.0:1789762937.345144:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239782203742 time 239782365114 state 0x0 ref 1 00000100:00100000:3.0:1789762937.345181:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630784:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762937.345245:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.345268:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762937.345274:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762937.345282:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.345302:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.350013:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.350033:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.350045:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.350056:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f79d0a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762937.350062:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.350095:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.350118:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.350128:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5fe624/0x5915dfb1c1b5b032 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762937.350217:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630784:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5045us (95108us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762937.350235:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 152 00000100:00100000:1.0:1789762937.350255:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239782203742 time 239782365114 state 0x2 ref 0 00000100:00100000:0.0:1789762937.354355:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762937.354489:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246630912 00000100:00100000:2.0:1789762937.354504:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246630912 00000100:00100000:2.0:1789762937.354583:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239782203742 time 239782365114 state 0x0 ref 1 00000100:00100000:2.0:1789762937.354603:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239882365114 time 239782365114 state 0x1 ref 1 00000100:00100000:0.0:1789762937.445271:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239882365114 time 239882489140 state 0x0 ref 1 00000100:00100000:0.0:1789762937.445301:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630912:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762937.445344:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.445361:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762937.445366:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762937.445372:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.445414:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.449955:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.449969:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.449978:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.449984:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7aa3c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762937.449988:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.450007:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.450023:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.450030:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe2dcee1/0x5915dfb1c1b5b039 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762937.450093:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246630912:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4803us (95741us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762937.450107:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 153 00000100:00100000:3.0:1789762937.450122:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239882365114 time 239882489140 state 0x2 ref 0 00000100:00100000:1.0:1789762937.452618:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762937.452689:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631040 00000100:00100000:2.0:1789762937.452705:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631040 00000100:00100000:2.0:1789762937.452746:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239882365114 time 239882489140 state 0x0 ref 1 00000100:00100000:2.0:1789762937.452779:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239982489140 time 239882489140 state 0x1 ref 1 00000100:00100000:3.0:1789762937.545371:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239982489140 time 239982602744 state 0x0 ref 1 00000100:00100000:3.0:1789762937.545394:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246631040:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762937.545429:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.545443:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762937.545447:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762937.545451:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.545477:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.548177:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.548191:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.548202:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.548222:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762937.548228:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.548239:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.548258:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762937.548268:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5b040 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762937.548344:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246631040:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2957us (95726us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762937.548355:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 154 00000100:00100000:3.0:1789762937.548367:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239982489140 time 239982602744 state 0x2 ref 0 00000100:00100000:1.0:1789762937.550935:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762937.550974:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631168 00000100:00100000:3.0:1789762937.550982:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631168 00000100:00100000:3.0:1789762937.551021:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 239982489140 time 239982602744 state 0x0 ref 1 00000100:00100000:3.0:1789762937.551036:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240082602744 time 239982602744 state 0x1 ref 1 00000100:00100000:0.0:1789762937.645502:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240082602744 time 240082732369 state 0x0 ref 1 00000100:00100000:0.0:1789762937.645525:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246631168:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762937.645562:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.645576:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762937.645580:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762937.645584:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.645596:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.648098:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.648109:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.648117:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.648134:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762937.648137:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.648144:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.648156:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762937.648162:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b047 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762937.648209:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246631168:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2692us (97275us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762937.648218:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:0.0:1789762937.648229:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240082602744 time 240082732369 state 0x2 ref 0 00000100:00100000:0.0:1789762937.650202:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762937.650246:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631296 00000100:00100000:3.0:1789762937.650254:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631296 00000100:00100000:3.0:1789762937.650290:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240082602744 time 240082732369 state 0x0 ref 1 00000100:00100000:3.0:1789762937.650301:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240182732369 time 240082732369 state 0x1 ref 1 00000004:00080000:1.0:1789762937.658877:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240096123901ns, next at 241096121269ns, rc = 0 00000100:00100000:2.0:1789762937.658885:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254929536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762937.658938:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762937.658976:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929536 00000100:00100000:3.0:1789762937.658983:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929536 00000100:00080000:2.0:1789762937.659025:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762937.659032:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789762937.659041:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254929536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789762937.659062:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3817762816 avail 3586240512 00000100:00100000:3.0:1789762937.659110:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254929536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762937.659126:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789762937.659186:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254929536:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789762937.660654:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000001:00080000:1.0:1789762937.660671:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:1.0:1789762937.660678:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000100:00100000:0.0:1789762937.660768:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789762937.660780:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254929664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762937.660807:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762937.660831:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929664 00000100:00100000:1.0:1789762937.660835:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929664 00000100:00100000:1.0:1789762937.660868:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789762937.660875:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254929664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762937.660889:0:12136:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:9 count 1 00002000:00010000:1.0:1789762937.660916:0:12136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 5242880, mtime: 0x6aad9d6f, atime: 0x0, ctime: 0x6aad9d6f, blocks: 0x800 00010000:00010000:1.0:1789762937.660924:0:12136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.660937:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=240s v=(0 0) 00010000:00010000:1.0:1789762937.660941:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762937.660947:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.660961:0:12136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.660971:0:12136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.660977:0:12136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.660995:0:12136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762937.661018:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762937.661025:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.661034:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762937.661037:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.661044:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.661057:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.661063:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b7a906f/0x5915dfb1c1b5b04e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.661086:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762937.661088:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762937.661089:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762937.662299:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254929664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1423us (1488us total) trans 4294967634 rc 0/0 00000100:00100000:1.0:1789762937.662308:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:0.0:1789762937.662331:0:3417:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c6cf9180/2, rc 0, transno 4294967634 00000100:00100000:0.0:1789762937.662339:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254929664:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789762937.722903:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762937.745582:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240182732369 time 240182815722 state 0x0 ref 1 00000100:00100000:1.0:1789762937.745607:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246631296:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762937.745656:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.745682:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762937.745685:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762937.745691:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.745701:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.748689:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.748704:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.748715:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.748723:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3055800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762937.748728:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.748740:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.748779:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762937.748796:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000549f4520/0x5915dfb1c1b5b055 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762937.748843:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246631296:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3247us (98642us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762937.748850:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:1.0:1789762937.748858:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240182732369 time 240182815722 state 0x2 ref 0 00000100:00100000:1.0:1789762937.750859:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762937.750906:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631424 00000100:00100000:3.0:1789762937.750915:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631424 00000100:00100000:3.0:1789762937.750949:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240182732369 time 240182815722 state 0x0 ref 1 00000100:00100000:3.0:1789762937.750960:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240282815722 time 240182815722 state 0x1 ref 1 00000100:00100000:2.0:1789762937.845704:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240282815722 time 240282934795 state 0x0 ref 1 00000100:00100000:2.0:1789762937.845730:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246631424:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762937.845792:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.845807:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.845811:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.845816:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.845827:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.848773:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.848785:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.848792:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.848809:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762937.848813:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.848820:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.848833:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.848838:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b05c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762937.848885:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246631424:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3165us (98026us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762937.848892:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:2.0:1789762937.848900:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240282815722 time 240282934795 state 0x2 ref 0 00000100:00100000:3.0:1789762937.850860:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762937.850900:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631552 00000100:00100000:0.0:1789762937.850908:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631552 00000100:00100000:0.0:1789762937.850946:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240282815722 time 240282934795 state 0x0 ref 1 00000100:00100000:0.0:1789762937.850957:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240382934795 time 240282934795 state 0x1 ref 1 00000100:00100000:2.0:1789762937.945813:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240382934795 time 240383044079 state 0x0 ref 1 00000100:00100000:2.0:1789762937.945839:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246631552:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762937.945876:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.945908:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.945912:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762937.945917:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.945929:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.948638:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.948648:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.948655:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.948660:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762937.948663:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.948669:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.948682:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762937.948699:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b063 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762937.948748:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246631552:12345-192.168.203.36@tcp:3:dd.500 Request processed in 2920us (97888us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762937.948780:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:2.0:1789762937.948788:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240382934795 time 240383044079 state 0x2 ref 0 00000100:00100000:3.0:1789762937.950774:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762937.950817:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631680 00000100:00100000:1.0:1789762937.950825:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631680 00000100:00100000:1.0:1789762937.950859:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240382934795 time 240383044079 state 0x0 ref 1 00000100:00100000:1.0:1789762937.950870:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240483044079 time 240383044079 state 0x1 ref 1 00000100:00100000:1.0:1789762938.045873:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240483044079 time 240483103964 state 0x0 ref 1 00000100:00100000:1.0:1789762938.045898:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246631680:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762938.045942:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.045955:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762938.045959:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762938.045963:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.045988:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.048940:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.048957:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.048967:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.048974:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33e2da2800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762938.048978:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.048986:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.049001:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.049009:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7062bbb/0x5915dfb1c1b5b06a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762938.049092:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246631680:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3202us (98337us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762938.049102:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:1.0:1789762938.049114:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240483044079 time 240483103964 state 0x2 ref 0 00000100:00100000:1.0:1789762938.051077:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762938.051138:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631808 00000100:00100000:2.0:1789762938.051148:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631808 00000100:00100000:2.0:1789762938.051191:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240483044079 time 240483103964 state 0x0 ref 1 00000100:00100000:2.0:1789762938.051206:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240583103964 time 240483103964 state 0x1 ref 1 00000100:00100000:2.0:1789762938.145907:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240583103964 time 240583141725 state 0x0 ref 1 00000100:00100000:2.0:1789762938.145926:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246631808:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762938.145960:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.145973:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762938.145977:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762938.145981:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.146001:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.148803:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.148815:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.148822:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.148828:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762938.148832:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.148838:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.148853:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.148858:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b071 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762938.148922:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246631808:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3001us (97844us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762938.148930:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:2.0:1789762938.148939:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240583103964 time 240583141725 state 0x2 ref 0 00000100:00100000:0.0:1789762938.150892:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762938.150934:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246631936 00000100:00100000:3.0:1789762938.150944:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246631936 00000100:00100000:3.0:1789762938.150985:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240583103964 time 240583141725 state 0x0 ref 1 00000100:00100000:3.0:1789762938.150997:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240683141725 time 240583141725 state 0x1 ref 1 00000100:00100000:3.0:1789762938.245960:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240683141725 time 240683191404 state 0x0 ref 1 00000100:00100000:3.0:1789762938.245983:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246631936:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762938.246019:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.246033:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762938.246037:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762938.246041:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.246067:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.248904:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.248915:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.248922:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.248926:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762938.248930:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.248936:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.248949:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.248954:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b078 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762938.249010:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246631936:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3035us (98119us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762938.249017:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:3.0:1789762938.249024:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240683141725 time 240683191404 state 0x2 ref 0 00000100:00100000:1.0:1789762938.251036:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762938.251064:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632064 00000100:00100000:3.0:1789762938.251072:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632064 00000100:00100000:3.0:1789762938.251104:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240683141725 time 240683191404 state 0x0 ref 1 00000100:00100000:3.0:1789762938.251114:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240783191404 time 240683191404 state 0x1 ref 1 00000100:00100000:0.0:1789762938.346055:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240783191404 time 240783281090 state 0x0 ref 1 00000100:00100000:0.0:1789762938.346084:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246632064:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762938.346128:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.346148:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762938.346153:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762938.346158:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.346171:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.349785:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.349796:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.349816:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.349821:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762938.349824:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.349831:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.349843:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762938.349849:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b07f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762938.349899:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246632064:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3825us (98864us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762938.349905:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:0.0:1789762938.349913:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240783191404 time 240783281090 state 0x2 ref 0 00000100:00100000:1.0:1789762938.352105:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762938.352176:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632192 00000100:00100000:2.0:1789762938.352184:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632192 00000100:00100000:2.0:1789762938.352221:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240783191404 time 240783281090 state 0x0 ref 1 00000100:00100000:2.0:1789762938.352232:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240883281090 time 240783281090 state 0x1 ref 1 00000100:00100000:3.0:1789762938.446160:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240883281090 time 240883392522 state 0x0 ref 1 00000100:00100000:3.0:1789762938.446190:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246632192:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762938.446227:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.446240:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762938.446243:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762938.446248:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.446259:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.449115:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.449125:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.449132:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.449137:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762938.449140:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.449147:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.449158:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762938.449163:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081344f69/0x5915dfb1c1b5b086 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762938.449214:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246632192:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3032us (97110us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762938.449222:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 163 00000100:00100000:3.0:1789762938.449236:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240883281090 time 240883392522 state 0x2 ref 0 00000100:00100000:0.0:1789762938.451098:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762938.451131:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632320 00000100:00100000:3.0:1789762938.451139:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632320 00000100:00100000:3.0:1789762938.451173:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240883281090 time 240883392522 state 0x0 ref 1 00000100:00100000:3.0:1789762938.451184:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240983392522 time 240883392522 state 0x1 ref 1 00000100:00100000:2.0:1789762938.546237:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240983392522 time 240983468210 state 0x0 ref 1 00000100:00100000:2.0:1789762938.546259:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246632320:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762938.546295:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.546309:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762938.546312:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762938.546317:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.546328:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.549884:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.549897:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.549913:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.549921:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762938.549925:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.549932:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.549944:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.549950:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b08d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762938.550001:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246632320:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3749us (98902us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762938.550009:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:2.0:1789762938.550027:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240983392522 time 240983468210 state 0x2 ref 0 00000100:00100000:1.0:1789762938.551855:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762938.551904:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632448 00000100:00100000:0.0:1789762938.551912:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632448 00000100:00100000:0.0:1789762938.551949:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 240983392522 time 240983468210 state 0x0 ref 1 00000100:00100000:0.0:1789762938.551966:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241083468210 time 240983468210 state 0x1 ref 1 00000100:00100000:1.0:1789762938.646307:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241083468210 time 241083539500 state 0x0 ref 1 00000100:00100000:1.0:1789762938.646330:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246632448:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762938.646366:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.646391:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762938.646396:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762938.646403:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.646420:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.650444:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.650464:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.650470:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.650475:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762938.650478:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.650485:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.650498:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.650503:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b094 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762938.650549:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246632448:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4227us (98695us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762938.650557:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:1.0:1789762938.650564:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241083468210 time 241083539500 state 0x2 ref 0 00000100:00100000:1.0:1789762938.652561:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762938.652605:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632576 00000100:00100000:3.0:1789762938.652624:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632576 00000100:00100000:3.0:1789762938.652661:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241083468210 time 241083539500 state 0x0 ref 1 00000100:00100000:3.0:1789762938.652672:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241183539500 time 241083539500 state 0x1 ref 1 00000001:00080000:1.0:1789762938.683629:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00000100:00100000:1.0:1789762938.746442:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241183539500 time 241183673869 state 0x0 ref 1 00000100:00100000:1.0:1789762938.746464:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246632576:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762938.746500:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.746513:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762938.746517:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762938.746521:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.746532:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.746829:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762938.749778:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.749789:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.749796:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.749800:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762938.749804:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.749823:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.749836:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.749841:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b09b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762938.749890:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246632576:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3434us (97330us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762938.749898:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:1.0:1789762938.749906:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241183539500 time 241183673869 state 0x2 ref 0 00000100:00100000:1.0:1789762938.751856:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762938.751920:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632704 00000100:00100000:2.0:1789762938.751929:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632704 00000100:00100000:2.0:1789762938.751967:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241183539500 time 241183673869 state 0x0 ref 1 00000100:00100000:2.0:1789762938.751978:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241283673869 time 241183673869 state 0x1 ref 1 00000100:00100000:2.0:1789762938.846510:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241283673869 time 241283742644 state 0x0 ref 1 00000100:00100000:2.0:1789762938.846531:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246632704:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762938.846566:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.846579:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762938.846582:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762938.846587:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.846598:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.849747:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.849771:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.849788:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.849793:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762938.849796:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.849802:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.849814:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762938.849820:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762938.849865:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246632704:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3341us (98009us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762938.849871:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:2.0:1789762938.849878:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241283673869 time 241283742644 state 0x2 ref 0 00000100:00100000:3.0:1789762938.851697:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762938.851779:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632832 00000100:00100000:1.0:1789762938.851787:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632832 00000100:00100000:1.0:1789762938.851823:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241283673869 time 241283742644 state 0x0 ref 1 00000100:00100000:1.0:1789762938.851834:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241383742644 time 241283742644 state 0x1 ref 1 00000100:00100000:1.0:1789762938.946576:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241383742644 time 241383801542 state 0x0 ref 1 00000100:00100000:1.0:1789762938.946600:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246632832:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762938.946666:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.946680:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762938.946683:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762938.946688:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.946701:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.950296:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.950308:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.950314:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.950319:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762938.950322:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.950328:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.950351:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762938.950356:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b705cf/0x5915dfb1c1b5b0a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762938.950405:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246632832:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3814us (98708us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762938.950411:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:1.0:1789762938.950419:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241383742644 time 241383801542 state 0x2 ref 0 00000100:00100000:3.0:1789762938.952265:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762938.952302:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246632960 00000100:00100000:1.0:1789762938.952310:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246632960 00000100:00100000:1.0:1789762938.952344:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241383742644 time 241383801542 state 0x0 ref 1 00000100:00100000:1.0:1789762938.952355:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241483801542 time 241383801542 state 0x1 ref 1 00000100:00100000:0.0:1789762939.046697:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241483801542 time 241483929834 state 0x0 ref 1 00000100:00100000:0.0:1789762939.046731:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246632960:12345-192.168.203.36@tcp:3:dd.500 00000100:00080000:2.0:1789762939.046775:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762939.046785:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.046798:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762939.046802:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762939.046807:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.046817:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.050325:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.050348:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.050355:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.050360:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13ef600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762939.050364:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.050370:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.050383:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.050388:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541b3fd6/0x5915dfb1c1b5b0b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762939.050440:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246632960:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3728us (98174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762939.050446:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:2.0:1789762939.050454:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241483801542 time 241483929834 state 0x2 ref 0 00000100:00100000:0.0:1789762939.052473:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762939.052508:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633088 00000100:00100000:2.0:1789762939.052521:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633088 00000100:00100000:2.0:1789762939.052554:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241483801542 time 241483929834 state 0x0 ref 1 00000100:00100000:2.0:1789762939.052564:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241583929834 time 241483929834 state 0x1 ref 1 00000100:00100000:3.0:1789762939.146786:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241583929834 time 241584017654 state 0x0 ref 1 00000100:00100000:3.0:1789762939.146807:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246633088:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762939.146842:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.146856:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762939.146860:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762939.146865:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.146889:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.150102:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.150113:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.150120:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.150125:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762939.150129:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.150135:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.150149:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.150154:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b0b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762939.150222:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246633088:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3421us (97749us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762939.150229:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:3.0:1789762939.150237:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241583929834 time 241584017654 state 0x2 ref 0 00000100:00100000:1.0:1789762939.152090:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762939.152127:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633216 00000100:00100000:3.0:1789762939.152135:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633216 00000100:00100000:3.0:1789762939.152174:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241583929834 time 241584017654 state 0x0 ref 1 00000100:00100000:3.0:1789762939.152188:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241684017654 time 241584017654 state 0x1 ref 1 00000100:00100000:2.0:1789762939.246865:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241684017654 time 241684096922 state 0x0 ref 1 00000100:00100000:2.0:1789762939.246890:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246633216:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762939.246941:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.246955:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762939.246959:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762939.246964:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.246975:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.250360:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.250370:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.250377:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.250389:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762939.250393:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.250399:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.250412:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.250417:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0be lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762939.250467:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246633216:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3587us (98378us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762939.250475:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:2.0:1789762939.250483:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241684017654 time 241684096922 state 0x2 ref 0 00000100:00100000:1.0:1789762939.252683:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762939.252721:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633344 00000100:00100000:2.0:1789762939.252728:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633344 00000100:00100000:2.0:1789762939.252777:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241684017654 time 241684096922 state 0x0 ref 1 00000100:00100000:2.0:1789762939.252788:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241784096922 time 241684096922 state 0x1 ref 1 00000100:00100000:1.0:1789762939.347045:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241784096922 time 241784260274 state 0x0 ref 1 00000100:00100000:1.0:1789762939.347092:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246633344:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762939.347156:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762939.347185:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762939.347188:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762939.347193:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762939.347204:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.352806:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.352827:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.352840:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.352850:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec68e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762939.352856:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.352868:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.352903:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.352914:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e64f5e0/0x5915dfb1c1b5b0c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762939.353000:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246633344:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5924us (100313us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762939.353018:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:3.0:1789762939.353037:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241784096922 time 241784260274 state 0x2 ref 0 00000100:00100000:0.0:1789762939.355922:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762939.355955:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633472 00000100:00100000:3.0:1789762939.355963:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633472 00000100:00100000:3.0:1789762939.356002:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241784096922 time 241784260274 state 0x0 ref 1 00000100:00100000:3.0:1789762939.356017:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241884260274 time 241784260274 state 0x1 ref 1 00000100:00100000:1.0:1789762939.447171:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241884260274 time 241884403641 state 0x0 ref 1 00000100:00100000:1.0:1789762939.447192:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246633472:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762939.447226:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762939.447243:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762939.447248:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762939.447254:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762939.447269:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.452140:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.452152:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.452159:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.452177:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec68200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762939.452181:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.452187:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.452199:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.452204:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d8723b6/0x5915dfb1c1b5b0cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762939.452251:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246633472:12345-192.168.203.36@tcp:3:dd.500 Request processed in 5065us (96330us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762939.452258:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:3.0:1789762939.452265:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241884260274 time 241884403641 state 0x2 ref 0 00000100:00100000:0.0:1789762939.454225:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762939.454274:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633600 00000100:00100000:2.0:1789762939.454289:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633600 00000100:00100000:2.0:1789762939.454325:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241884260274 time 241884403641 state 0x0 ref 1 00000100:00100000:2.0:1789762939.454335:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241984403641 time 241884403641 state 0x1 ref 1 00000100:00100000:0.0:1789762939.547302:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241984403641 time 241984529779 state 0x0 ref 1 00000100:00100000:0.0:1789762939.547326:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246633600:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762939.547362:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.547392:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762939.547396:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762939.547401:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.547412:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.550793:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.550804:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.550810:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.550815:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767b600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762939.550819:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.550826:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.550838:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.550843:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe40edeb/0x5915dfb1c1b5b0d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762939.550905:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246633600:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3587us (96680us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762939.550914:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:2.0:1789762939.550922:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241984403641 time 241984529779 state 0x2 ref 0 00000100:00100000:1.0:1789762939.552781:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762939.552826:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633728 00000100:00100000:3.0:1789762939.552835:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633728 00000100:00100000:3.0:1789762939.552870:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 241984403641 time 241984529779 state 0x0 ref 1 00000100:00100000:3.0:1789762939.552881:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242084529779 time 241984529779 state 0x1 ref 1 00000100:00100000:1.0:1789762939.647434:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242084529779 time 242084660071 state 0x0 ref 1 00000100:00100000:1.0:1789762939.647474:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246633728:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762939.647512:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762939.647526:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762939.647529:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762939.647534:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762939.647547:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.650696:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.650712:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.650719:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.650724:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33e2da7c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762939.650727:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.650734:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.650746:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762939.650768:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0f92667/0x5915dfb1c1b5b0da lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762939.650814:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246633728:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3346us (98034us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762939.650821:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:3.0:1789762939.650830:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242084529779 time 242084660071 state 0x2 ref 0 00000100:00100000:3.0:1789762939.652704:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762939.652775:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633856 00000100:00100000:1.0:1789762939.652784:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633856 00000100:00100000:1.0:1789762939.652820:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242084529779 time 242084660071 state 0x0 ref 1 00000100:00100000:1.0:1789762939.652831:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242184660071 time 242084660071 state 0x1 ref 1 00000100:00100000:0.0:1789762939.747508:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242184660071 time 242184740664 state 0x0 ref 1 00000100:00100000:0.0:1789762939.747531:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246633856:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762939.747568:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.747582:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762939.747586:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762939.747591:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.747612:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.750634:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.750656:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.750663:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.750668:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762939.750671:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.750678:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.750690:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762939.750695:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b844de0/0x5915dfb1c1b5b0e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762939.750740:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246633856:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3217us (98036us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762939.750747:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:0.0:1789762939.750786:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242184660071 time 242184740664 state 0x2 ref 0 00000100:00100000:0.0:1789762939.752781:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762939.752829:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246633984 00000100:00100000:2.0:1789762939.752837:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246633984 00000100:00100000:2.0:1789762939.752873:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242184660071 time 242184740664 state 0x0 ref 1 00000100:00100000:2.0:1789762939.752884:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242284740664 time 242184740664 state 0x1 ref 1 00010000:00010000:0.0:1789762939.770868:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762939.847574:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242284740664 time 242284806819 state 0x0 ref 1 00000100:00100000:2.0:1789762939.847595:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246633984:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762939.847646:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.847664:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762939.847670:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762939.847676:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.847692:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.850825:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.850834:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.850840:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.850845:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762939.850848:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.850854:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.850866:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.850871:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762939.850913:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246633984:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3324us (98132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762939.850920:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:2.0:1789762939.850934:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242284740664 time 242284806819 state 0x2 ref 0 00000100:00100000:1.0:1789762939.852772:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762939.852812:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246634112 00000100:00100000:3.0:1789762939.852820:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246634112 00000100:00100000:3.0:1789762939.852855:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242284740664 time 242284806819 state 0x0 ref 1 00000100:00100000:3.0:1789762939.852866:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242384806819 time 242284806819 state 0x1 ref 1 00000100:00100000:2.0:1789762939.947669:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242384806819 time 242384901527 state 0x0 ref 1 00000100:00100000:2.0:1789762939.947690:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246634112:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762939.947725:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.947738:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762939.947741:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762939.947746:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.947777:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.950874:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.950883:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.950889:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.950893:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762939.950908:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.950915:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.950928:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762939.950933:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b0ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762939.950976:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246634112:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3294us (98207us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762939.950986:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:2.0:1789762939.950997:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242384806819 time 242384901527 state 0x2 ref 0 00000100:00100000:3.0:1789762939.952833:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762939.952873:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246634240 00000100:00100000:0.0:1789762939.952882:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246634240 00000100:00100000:0.0:1789762939.952918:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242384806819 time 242384901527 state 0x0 ref 1 00000100:00100000:0.0:1789762939.952929:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242484901527 time 242384901527 state 0x1 ref 1 00000100:00100000:3.0:1789762940.047746:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242484901527 time 242484977782 state 0x0 ref 1 00000100:00100000:3.0:1789762940.047784:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246634240:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762940.047819:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.047832:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762940.047836:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762940.047840:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.047852:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.051244:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.051257:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.051280:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.051285:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33e2da7600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762940.051288:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.051295:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.051308:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.051314:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2bf116d/0x5915dfb1c1b5b0f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762940.051361:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246634240:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3585us (98528us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762940.051368:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:3.0:1789762940.051376:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242484901527 time 242484977782 state 0x2 ref 0 00000100:00100000:3.0:1789762940.053568:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762940.053630:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246634368 00000100:00100000:2.0:1789762940.053639:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246634368 00000100:00100000:2.0:1789762940.053677:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242484901527 time 242484977782 state 0x0 ref 1 00000100:00100000:2.0:1789762940.053687:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242584977782 time 242484977782 state 0x1 ref 1 00000100:00100000:1.0:1789762940.147840:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242584977782 time 242585070606 state 0x0 ref 1 00000100:00100000:1.0:1789762940.147865:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246634368:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762940.147902:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.147932:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762940.147936:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762940.147940:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.147951:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.151092:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.151103:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.151110:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.151115:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c3054a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762940.151119:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.151125:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.151138:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.151154:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef35432d/0x5915dfb1c1b5b0fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762940.151199:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246634368:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3344us (97632us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762940.151206:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:1.0:1789762940.151214:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242584977782 time 242585070606 state 0x2 ref 0 00000100:00100000:1.0:1789762940.153802:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762940.153858:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246634496 00000100:00100000:2.0:1789762940.153867:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246634496 00000100:00100000:2.0:1789762940.153914:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242584977782 time 242585070606 state 0x0 ref 1 00000100:00100000:2.0:1789762940.153944:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242685070606 time 242585070606 state 0x1 ref 1 00000100:00100000:2.0:1789762940.247925:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242685070606 time 242685152626 state 0x0 ref 1 00000100:00100000:2.0:1789762940.247957:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246634496:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762940.248004:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.248023:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762940.248029:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762940.248036:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.248052:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.251792:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.251811:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.251818:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.251839:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762940.251843:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.251849:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.251863:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.251868:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b104 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762940.251916:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246634496:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3971us (98117us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762940.251924:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:2.0:1789762940.251932:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242685070606 time 242685152626 state 0x2 ref 0 00000100:00100000:0.0:1789762940.254093:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762940.254138:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246634624 00000100:00100000:3.0:1789762940.254147:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246634624 00000100:00100000:3.0:1789762940.254191:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242685070606 time 242685152626 state 0x0 ref 1 00000100:00100000:3.0:1789762940.254212:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242785152626 time 242685152626 state 0x1 ref 1 00000100:00100000:3.0:1789762940.347985:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242785152626 time 242785213094 state 0x0 ref 1 00000100:00100000:3.0:1789762940.348013:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246634624:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762940.348053:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.348070:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762940.348074:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762940.348081:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.348094:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.351295:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.351307:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.351317:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.351339:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767ce00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762940.351346:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.351355:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.351372:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.351381:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000024dea66/0x5915dfb1c1b5b10b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762940.351438:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246634624:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3434us (97344us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762940.351447:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:3.0:1789762940.351457:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242785152626 time 242785213094 state 0x2 ref 0 00000100:00100000:3.0:1789762940.353521:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762940.353576:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246634752 00000100:00100000:1.0:1789762940.353585:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246634752 00000100:00100000:1.0:1789762940.353641:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242785152626 time 242785213094 state 0x0 ref 1 00000100:00100000:1.0:1789762940.353657:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242885213094 time 242785213094 state 0x1 ref 1 00000100:00100000:0.0:1789762940.448104:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242885213094 time 242885336091 state 0x0 ref 1 00000100:00100000:0.0:1789762940.448126:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246634752:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762940.448161:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.448175:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762940.448179:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762940.448183:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.448194:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.451371:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.451382:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.451401:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.451407:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762940.451410:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.451416:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.451429:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762940.451434:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762940.451484:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246634752:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3366us (97964us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762940.451491:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:0.0:1789762940.451499:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242885213094 time 242885336091 state 0x2 ref 0 00000100:00100000:1.0:1789762940.453350:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762940.453408:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246634880 00000100:00100000:2.0:1789762940.453418:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246634880 00000100:00100000:2.0:1789762940.453455:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242885213094 time 242885336091 state 0x0 ref 1 00000100:00100000:2.0:1789762940.453466:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242985336091 time 242885336091 state 0x1 ref 1 00000100:00100000:2.0:1789762940.548183:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242985336091 time 242985414549 state 0x0 ref 1 00000100:00100000:2.0:1789762940.548214:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246634880:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762940.548251:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.548266:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762940.548269:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762940.548274:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.548284:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.551576:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.551587:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.551595:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.551613:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762940.551617:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.551624:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.551644:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.551650:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b119 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762940.551697:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246634880:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3489us (98348us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762940.551704:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 184 00000100:00100000:2.0:1789762940.551712:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242985336091 time 242985414549 state 0x2 ref 0 00000100:00100000:1.0:1789762940.553650:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762940.553684:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635008 00000100:00100000:3.0:1789762940.553693:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635008 00000100:00100000:3.0:1789762940.553728:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 242985336091 time 242985414549 state 0x0 ref 1 00000100:00100000:3.0:1789762940.553739:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243085414549 time 242985414549 state 0x1 ref 1 00000100:00100000:2.0:1789762940.648279:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243085414549 time 243085511244 state 0x0 ref 1 00000100:00100000:2.0:1789762940.648303:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635008:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762940.648341:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.648355:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762940.648358:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762940.648363:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.648376:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.651539:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.651554:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.651564:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.651572:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762940.651576:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.651583:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.651607:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.651613:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b120 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762940.651660:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635008:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3366us (98010us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762940.651666:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:2.0:1789762940.651680:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243085414549 time 243085511244 state 0x2 ref 0 00000100:00100000:1.0:1789762940.653783:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762940.653830:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635136 00000100:00100000:0.0:1789762940.653837:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635136 00000100:00100000:0.0:1789762940.653872:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243085414549 time 243085511244 state 0x0 ref 1 00000100:00100000:0.0:1789762940.653899:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243185511244 time 243085511244 state 0x1 ref 1 00000100:00100000:0.0:1789762940.730969:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f769b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254930048:0@lo:400:kworker.0 00000100:00100000:1.0:1789762940.730969:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254929792:0@lo:400:kworker.0 00000100:00100000:2.0:1789762940.730972:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c553ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762940.731018:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254930176:0@lo:400:kworker.0 00000100:00100000:1.0:1789762940.731061:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762940.731078:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762940.731079:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762940.731123:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929920 00000100:00100000:3.0:1789762940.731131:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929920 00000100:00100000:0.0:1789762940.731163:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254930560:0@lo:400:kworker.0 00000100:00100000:2.0:1789762940.731167:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254930432:0@lo:400:kworker.0 00000100:00100000:1.0:1789762940.731174:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254930304:0@lo:400:kworker.0 00000100:00100000:3.0:1789762940.731194:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762940.731201:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762940.731212:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254929920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762940.731219:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762940.731224:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789762940.731244:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 24519232 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762940.731256:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930560 00000100:00100000:0.0:1789762940.731261:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930560 00000100:00100000:2.0:1789762940.731272:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930048 00000100:00100000:2.0:1789762940.731279:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930048 00000100:00100000:1.0:1789762940.731288:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762940.731294:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930304 00000100:00100000:0.0:1789762940.731299:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930304 00000100:00100000:3.0:1789762940.731308:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254929920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762940.731323:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930432 00000100:00100000:2.0:1789762940.731327:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930432 00000100:00100000:3.0:1789762940.731328:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789762940.731336:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789762940.731337:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930176 00000100:00100000:0.0:1789762940.731346:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762940.731355:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930176 00000100:00100000:2.0:1789762940.731361:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789762940.731367:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789762940.731372:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254930048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762940.731379:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254930432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762940.731395:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254930560:12345-0@lo:400:kworker.0 Request processed in 51us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762940.731401:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789762940.731406:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789762940.731414:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254930176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762940.731424:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254930048:12345-0@lo:400:kworker.0 Request processed in 54us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762940.731424:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254930432:12345-0@lo:400:kworker.0 Request processed in 47us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762940.731433:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789762940.731437:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789762940.731447:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789762940.731452:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254930304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762940.731459:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254930176:12345-0@lo:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762940.731465:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789762940.731475:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254929792 00000100:00100000:3.0:1789762940.731481:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254929792 00000100:00100000:2.0:1789762940.731497:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254930432:0@lo:400:kworker.0 00000100:00100000:1.0:1789762940.731514:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254930176:0@lo:400:kworker.0 00000100:00100000:0.0:1789762940.731515:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254930304:12345-0@lo:400:kworker.0 Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762940.731518:0:3420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967331 gen 2 00000100:00100000:3.0:1789762940.731521:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000004:00080000:2.0:1789762940.731525:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c2162300, transno 4294967330 00000100:00100000:3.0:1789762940.731533:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254929792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762940.731535:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000004:00080000:2.0:1789762940.731540:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c2161c00, transno 4294967331 00000100:00100000:2.0:1789762940.731556:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c553ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762940.731561:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254930304:0@lo:400:kworker.0 00000100:00100000:0.0:1789762940.731587:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254930560:0@lo:400:kworker.0 00000100:00100000:0.0:1789762940.731617:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f769b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254930048:0@lo:400:kworker.0 00000100:00080000:1.0:1789762940.731618:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762940.731625:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762940.731629:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762940.731634:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3419:x1876702254929792:12345-0@lo:400:kworker.0 Request processed in 101us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762940.731643:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789762940.731668:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3419:1876702254929792:0@lo:400:kworker.0 00000100:00100000:3.0:1789762940.748364:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243185511244 time 243185601469 state 0x0 ref 1 00000100:00100000:3.0:1789762940.748379:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246635136:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762940.748411:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.748424:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762940.748428:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762940.748432:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.748443:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.751329:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.751338:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.751344:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.751349:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762940.751353:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.751359:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.751382:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.751388:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b127 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762940.751428:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246635136:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3052us (97646us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762940.751434:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 186 00000100:00100000:3.0:1789762940.751441:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243185511244 time 243185601469 state 0x2 ref 0 00000100:00100000:1.0:1789762940.753295:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762940.753343:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635264 00000100:00100000:2.0:1789762940.753349:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635264 00000100:00100000:2.0:1789762940.753379:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243185511244 time 243185601469 state 0x0 ref 1 00000100:00100000:2.0:1789762940.753388:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243285601469 time 243185601469 state 0x1 ref 1 00010000:00010000:2.0:1789762940.794880:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762940.848467:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243285601469 time 243285699093 state 0x0 ref 1 00000100:00100000:1.0:1789762940.848494:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246635264:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:1.0:1789762940.848536:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.848555:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762940.848560:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762940.848565:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762940.848577:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.851958:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.851968:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.851974:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.851979:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33e2da3e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762940.851982:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.851989:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.852008:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762940.852014:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002030b8f0/0x5915dfb1c1b5b12e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762940.852068:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246635264:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3585us (98773us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762940.852074:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:3.0:1789762940.852090:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243285601469 time 243285699093 state 0x2 ref 0 00000100:00100000:1.0:1789762940.854131:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762940.854181:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635392 00000100:00100000:2.0:1789762940.854189:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635392 00000100:00100000:2.0:1789762940.854224:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243285601469 time 243285699093 state 0x0 ref 1 00000100:00100000:2.0:1789762940.854235:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243385699093 time 243285699093 state 0x1 ref 1 00000100:00100000:2.0:1789762940.949617:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243385699093 time 243386838990 state 0x0 ref 1 00000100:00100000:2.0:1789762940.949641:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246635392:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762940.949679:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.949692:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762940.949696:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762940.949701:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.949712:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.952643:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.952654:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.952668:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.952673:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762940.952676:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.952683:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.952695:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762940.952700:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762940.952748:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246635392:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3116us (98618us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762940.952782:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:2.0:1789762940.952790:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243385699093 time 243386838990 state 0x2 ref 0 00000100:00100000:1.0:1789762940.954788:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762940.954830:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635520 00000100:00100000:3.0:1789762940.954838:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635520 00000100:00100000:3.0:1789762940.954874:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243385699093 time 243386838990 state 0x0 ref 1 00000100:00100000:3.0:1789762940.954884:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243486838990 time 243386838990 state 0x1 ref 1 00000100:00100000:3.0:1789762941.049680:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243486838990 time 243486911416 state 0x0 ref 1 00000100:00100000:3.0:1789762941.049716:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635520:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762941.049775:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762941.049786:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789762941.049790:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.049813:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.049819:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.049831:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.053846:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.053896:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.053910:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.053921:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762941.053930:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.053950:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.053982:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.054002:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b13c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762941.054098:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635520:12345-192.168.203.36@tcp:3:dd.500 Request processed in 4399us (99307us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762941.054111:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:0.0:1789762941.054126:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243486838990 time 243486911416 state 0x2 ref 0 00000100:00100000:1.0:1789762941.056657:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762941.056698:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635648 00000100:00100000:3.0:1789762941.056707:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635648 00000100:00100000:3.0:1789762941.056742:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243486838990 time 243486911416 state 0x0 ref 1 00000100:00100000:3.0:1789762941.056771:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243586911416 time 243486911416 state 0x1 ref 1 00000100:00100000:2.0:1789762941.149787:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243586911416 time 243587015743 state 0x0 ref 1 00000100:00100000:2.0:1789762941.149815:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635648:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762941.149867:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.149883:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.149888:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.149895:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.149910:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.152731:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.152742:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.152763:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.152769:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762941.152773:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.152779:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.152805:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.152814:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b143 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762941.152877:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635648:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3071us (96239us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762941.152885:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:2.0:1789762941.152893:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243586911416 time 243587015743 state 0x2 ref 0 00000100:00100000:1.0:1789762941.154725:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762941.154786:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635776 00000100:00100000:2.0:1789762941.154794:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635776 00000100:00100000:2.0:1789762941.154837:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243586911416 time 243587015743 state 0x0 ref 1 00000100:00100000:2.0:1789762941.154853:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243687015743 time 243587015743 state 0x1 ref 1 00000100:00100000:2.0:1789762941.249863:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243687015743 time 243687082433 state 0x0 ref 1 00000100:00100000:2.0:1789762941.249893:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246635776:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762941.249942:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.249957:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.249973:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.249978:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.249989:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.253671:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.253690:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.253697:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.253702:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762941.253706:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.253712:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.253725:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.253730:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b14a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762941.253811:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246635776:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3932us (99087us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762941.253819:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1789762941.253827:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243687015743 time 243687082433 state 0x2 ref 0 00000100:00100000:1.0:1789762941.255872:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762941.255924:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246635904 00000100:00100000:0.0:1789762941.255938:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246635904 00000100:00100000:0.0:1789762941.255980:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243687015743 time 243687082433 state 0x0 ref 1 00000100:00100000:0.0:1789762941.255995:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243787082433 time 243687082433 state 0x1 ref 1 00000100:00100000:3.0:1789762941.315845:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762941.315909:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762941.315938:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762941.315966:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636160 00000100:00100000:3.0:1789762941.315976:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762941.315978:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636160 00000100:00100000:1.0:1789762941.316006:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636032 00000100:00100000:3.0:1789762941.316008:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636288 00000100:00100000:1.0:1789762941.316013:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636032 00000100:00100000:3.0:1789762941.316016:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636288 00000100:00100000:0.0:1789762941.316050:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636416 00000100:00100000:0.0:1789762941.316057:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636416 00000100:00100000:1.0:1789762941.316062:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 269 00000100:00100000:2.0:1789762941.316068:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:3.0:1789762941.316074:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:1.0:1789762941.316076:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246636032:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762941.316086:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246636160:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762941.316093:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246636288:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762941.316099:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:0.0:1789762941.316112:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246636416:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762941.316161:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246636160:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762941.316169:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246636032:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762941.316170:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246636288:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762941.316171:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246636416:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762941.316184:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:1.0:1789762941.316192:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 269 00000100:00100000:0.0:1789762941.316198:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:3.0:1789762941.316198:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00080000:0.0:1789762941.316266:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762941.316271:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762941.349964:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243787082433 time 243787196291 state 0x0 ref 1 00000100:00100000:3.0:1789762941.349987:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635904:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762941.350043:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.350056:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.350060:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.350064:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.350075:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.353164:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.353177:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.353187:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.353195:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33e2da3600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762941.353199:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.353210:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.353249:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.353258:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b151 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762941.353311:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246635904:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3331us (97437us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762941.353322:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:3.0:1789762941.353332:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243787082433 time 243787196291 state 0x2 ref 0 00000100:00100000:3.0:1789762941.355146:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762941.355217:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636544 00000100:00100000:2.0:1789762941.355226:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636544 00000100:00100000:2.0:1789762941.355269:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243787082433 time 243787196291 state 0x0 ref 1 00000100:00100000:2.0:1789762941.355283:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243887196291 time 243787196291 state 0x1 ref 1 00000100:00100000:3.0:1789762941.450066:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243887196291 time 243887294572 state 0x0 ref 1 00000100:00100000:3.0:1789762941.450097:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246636544:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762941.450136:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.450150:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.450153:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.450158:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.450168:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.453797:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.453809:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.453816:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.453822:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33e2da3600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762941.453826:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.453858:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.453872:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.453878:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be91cebc/0x5915dfb1c1b5b158 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762941.453925:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246636544:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3841us (98780us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762941.453935:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:0.0:1789762941.453946:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243887196291 time 243887294572 state 0x2 ref 0 00000100:00100000:3.0:1789762941.455925:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762941.455975:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636672 00000100:00100000:2.0:1789762941.455984:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636672 00000100:00100000:2.0:1789762941.456028:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243887196291 time 243887294572 state 0x0 ref 1 00000100:00100000:2.0:1789762941.456043:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243987294572 time 243887294572 state 0x1 ref 1 00000100:00100000:2.0:1789762941.550123:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243987294572 time 243987353653 state 0x0 ref 1 00000100:00100000:2.0:1789762941.550148:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246636672:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762941.550189:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.550204:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.550207:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.550212:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.550222:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.553397:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.553412:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.553424:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.553434:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762941.553439:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.553463:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.553482:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.553492:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b15f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762941.553548:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246636672:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3408us (97622us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762941.553559:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:2.0:1789762941.553570:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243987294572 time 243987353653 state 0x2 ref 0 00000100:00100000:1.0:1789762941.555419:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762941.555457:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636800 00000100:00100000:3.0:1789762941.555465:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636800 00000100:00100000:3.0:1789762941.555499:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 243987294572 time 243987353653 state 0x0 ref 1 00000100:00100000:3.0:1789762941.555510:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244087353653 time 243987353653 state 0x1 ref 1 00000100:00100000:0.0:1789762941.650230:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244087353653 time 244087462232 state 0x0 ref 1 00000100:00100000:0.0:1789762941.650254:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246636800:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762941.650289:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.650303:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762941.650306:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762941.650311:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.650341:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.653357:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.653367:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.653374:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.653379:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762941.653382:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.653389:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.653401:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762941.653405:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762941.653462:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246636800:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3216us (98043us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762941.653469:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:0.0:1789762941.653477:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244087353653 time 244087462232 state 0x2 ref 0 00000100:00100000:2.0:1789762941.655393:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762941.655438:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246636928 00000100:00100000:0.0:1789762941.655448:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246636928 00000100:00100000:0.0:1789762941.655491:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244087353653 time 244087462232 state 0x0 ref 1 00000100:00100000:0.0:1789762941.655505:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244187462232 time 244087462232 state 0x1 ref 1 00000100:00100000:2.0:1789762941.750321:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244187462232 time 244187553155 state 0x0 ref 1 00000100:00100000:2.0:1789762941.750345:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246636928:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762941.750380:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.750394:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.750398:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.750402:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.750426:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.753779:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.753790:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.753796:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.753801:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762941.753805:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.753811:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.753822:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.753838:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b16d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762941.753888:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246636928:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3552us (98495us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762941.753897:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:3.0:1789762941.753908:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244187462232 time 244187553155 state 0x2 ref 0 00000100:00100000:3.0:1789762941.755953:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762941.756009:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637056 00000100:00100000:2.0:1789762941.756018:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637056 00000100:00100000:2.0:1789762941.756054:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244187462232 time 244187553155 state 0x0 ref 1 00000100:00100000:2.0:1789762941.756065:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244287553155 time 244187553155 state 0x1 ref 1 00010000:00010000:2.0:1789762941.818924:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762941.850370:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244287553155 time 244287604715 state 0x0 ref 1 00000100:00100000:2.0:1789762941.850393:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637056:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762941.850429:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.850442:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.850445:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762941.850450:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.850459:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.853894:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.853918:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.853925:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.853930:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762941.853934:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.853940:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.853952:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762941.853957:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b174 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762941.854020:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637056:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3635us (98077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762941.854027:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:2.0:1789762941.854035:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244287553155 time 244287604715 state 0x2 ref 0 00000100:00100000:1.0:1789762941.856038:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762941.856093:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637184 00000100:00100000:0.0:1789762941.856102:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637184 00000100:00100000:0.0:1789762941.856138:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244287553155 time 244287604715 state 0x0 ref 1 00000100:00100000:0.0:1789762941.856149:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244387604715 time 244287604715 state 0x1 ref 1 00000100:00100000:3.0:1789762941.950466:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244387604715 time 244387687667 state 0x0 ref 1 00000100:00100000:3.0:1789762941.950487:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246637184:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762941.950534:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.950548:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.950551:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762941.950556:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.950567:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.953575:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.953605:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.953624:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.953629:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762941.953632:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.953638:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.953651:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762941.953656:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b17b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762941.953701:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246637184:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3221us (97663us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762941.953707:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:3.0:1789762941.953715:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244387604715 time 244387687667 state 0x2 ref 0 00000100:00100000:0.0:1789762941.955831:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762941.955866:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637312 00000100:00100000:3.0:1789762941.955880:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637312 00000100:00100000:3.0:1789762941.955912:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244387604715 time 244387687667 state 0x0 ref 1 00000100:00100000:3.0:1789762941.955923:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244487687667 time 244387687667 state 0x1 ref 1 00000100:00100000:3.0:1789762942.050516:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244487687667 time 244487747422 state 0x0 ref 1 00000100:00100000:3.0:1789762942.050538:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637312:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762942.050574:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.050600:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762942.050604:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762942.050609:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.050620:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.053909:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.053920:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.053927:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.053938:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762942.053942:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.053949:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.053961:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.053966:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b182 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762942.054011:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637312:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3480us (98180us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762942.054019:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:3.0:1789762942.054027:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244487687667 time 244487747422 state 0x2 ref 0 00000100:00100000:1.0:1789762942.055969:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762942.056033:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637440 00000100:00100000:2.0:1789762942.056047:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637440 00000100:00100000:2.0:1789762942.056082:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244487687667 time 244487747422 state 0x0 ref 1 00000100:00100000:2.0:1789762942.056093:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244587747422 time 244487747422 state 0x1 ref 1 00000100:00100000:3.0:1789762942.150662:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244587747422 time 244587882582 state 0x0 ref 1 00000100:00100000:3.0:1789762942.150686:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246637440:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762942.150723:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.150783:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762942.150787:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762942.150793:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.150804:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.153983:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.153993:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.153999:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.154004:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762942.154008:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.154014:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.154026:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.154040:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b189 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762942.154089:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246637440:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3412us (98119us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762942.154099:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:3.0:1789762942.154110:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244587747422 time 244587882582 state 0x2 ref 0 00000100:00100000:3.0:1789762942.156310:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762942.156363:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637568 00000100:00100000:0.0:1789762942.156371:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637568 00000100:00100000:0.0:1789762942.156405:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244587747422 time 244587882582 state 0x0 ref 1 00000100:00100000:0.0:1789762942.156416:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244687882582 time 244587882582 state 0x1 ref 1 00000100:00100000:2.0:1789762942.250732:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244687882582 time 244687964895 state 0x0 ref 1 00000100:00100000:2.0:1789762942.250779:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246637568:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762942.250817:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.250832:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762942.250835:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762942.250840:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.250850:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.253874:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.253885:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.253892:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.253904:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762942.253907:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.253914:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.253926:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.253931:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b190 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762942.253980:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246637568:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3232us (97670us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762942.253987:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:2.0:1789762942.253994:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244687882582 time 244687964895 state 0x2 ref 0 00000100:00100000:0.0:1789762942.255941:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762942.255982:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637696 00000100:00100000:3.0:1789762942.255990:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637696 00000100:00100000:3.0:1789762942.256024:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244687882582 time 244687964895 state 0x0 ref 1 00000100:00100000:3.0:1789762942.256034:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244787964895 time 244687964895 state 0x1 ref 1 00000100:00100000:0.0:1789762942.351046:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244787964895 time 244788272268 state 0x0 ref 1 00000100:00100000:0.0:1789762942.351077:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637696:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:0.0:1789762942.351125:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.351145:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762942.351151:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762942.351157:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.351174:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.354647:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.354664:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.354675:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.354705:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7521e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762942.354710:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.354720:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.354739:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.354748:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4cc1511/0x5915dfb1c1b5b197 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762942.354837:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637696:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3772us (98895us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762942.354845:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:2.0:1789762942.354855:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244787964895 time 244788272268 state 0x2 ref 0 00000100:00100000:0.0:1789762942.356934:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762942.356976:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637824 00000100:00100000:3.0:1789762942.356984:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637824 00000100:00100000:3.0:1789762942.357022:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244787964895 time 244788272268 state 0x0 ref 1 00000100:00100000:3.0:1789762942.357033:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244888272268 time 244788272268 state 0x1 ref 1 00000100:00100000:3.0:1789762942.451103:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244888272268 time 244888330905 state 0x0 ref 1 00000100:00100000:3.0:1789762942.451133:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246637824:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:3.0:1789762942.451182:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.451197:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762942.451200:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762942.451205:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.451216:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.454803:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.454814:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.454820:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.454825:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82ce00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762942.454829:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.454835:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.454858:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.454864:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a11e59ed/0x5915dfb1c1b5b19e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762942.454910:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246637824:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3790us (97979us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762942.454917:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:3.0:1789762942.454924:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244888272268 time 244888330905 state 0x2 ref 0 00000100:00100000:3.0:1789762942.456922:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762942.456977:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246637952 00000100:00100000:2.0:1789762942.456985:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246637952 00000100:00100000:2.0:1789762942.457028:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244888272268 time 244888330905 state 0x0 ref 1 00000100:00100000:2.0:1789762942.457040:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244988330905 time 244888330905 state 0x1 ref 1 00000100:00100000:2.0:1789762942.551174:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244988330905 time 244988405897 state 0x0 ref 1 00000100:00100000:2.0:1789762942.551200:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637952:12345-192.168.203.36@tcp:3:dd.500 00010000:00010000:2.0:1789762942.551237:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.551251:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762942.551254:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762942.551259:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.551270:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.554793:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.554806:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.554816:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.554824:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762942.554829:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.554847:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.554873:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.554879:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b1a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762942.554925:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246637952:12345-192.168.203.36@tcp:3:dd.500 Request processed in 3736us (98004us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762942.554931:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:2.0:1789762942.554939:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33c545dc00 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33fc553900 gen 0 rate 10 depth 3 token 0 deadline 244988330905 time 244988405897 state 0x2 ref 0 00000100:00100000:3.0:1789762942.578688:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762942.578737:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246638080 00000100:00100000:1.0:1789762942.578747:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246638080 00000100:00100000:1.0:1789762942.578810:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:1.0:1789762942.578823:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5888:x1876702246638080:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762942.578839:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762942.578871:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5aee2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944847 expref: 6 pid: 7959 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.578898:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762942.578943:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:5888:x1876702246638080:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762942.578951:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:0.0:1789762942.586972:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762942.587043:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246638208 00000100:00100000:1.0:1789762942.587049:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246638208 00000100:00100000:1.0:1789762942.587100:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:1.0:1789762942.587111:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:12066:x1876702246638208:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1789762942.587128:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762942.587144:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b1ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894484e expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.587262:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68c00/0x5915dfb1c1b5b1b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.587273:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68c00/0x5915dfb1c1b5b1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.587282:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68c00/0x5915dfb1c1b5b1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762942.587334:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00000004:00200000:1.0:1789762942.587337:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762942.587351:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68c00/0x5915dfb1c1b5b1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.587370:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b1ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894484e expref: 11 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.587383:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68c00/0x5915dfb1c1b5b1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894484e expref: 10 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.587406:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:1.0:1789762942.587409:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762942.587413:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec68c00, rc 0) 00000100:00100000:1.0:1789762942.587449:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12066:x1876702246638208:12345-192.168.203.36@tcp:101:bash.0 Request processed in 341us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762942.587454:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:2.0:1789762942.591161:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762942.591212:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246638464 00000100:00100000:0.0:1789762942.591218:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246638464 00000100:00100000:0.0:1789762942.591262:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:0.0:1789762942.591272:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12390:x1876702246638464:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1789762942.591285:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762942.591294:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b1ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944855 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762942.591374:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00010000:00010000:0.0:1789762942.591454:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b1ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944855 expref: 12 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.591467:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92500) 00010000:00010000:0.0:1789762942.591470:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789762942.591475:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b1ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944855 expref: 12 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.591487:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767ce00, rc 0) 00000100:00100000:0.0:1789762942.591525:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12390:x1876702246638464:12345-192.168.203.36@tcp:101:rm.0 Request processed in 255us (365us total) trans 4294967440 rc 301/301 00000100:00100000:0.0:1789762942.591534:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:3.0:1789762942.592957:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762942.593000:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246638592 00000100:00100000:1.0:1789762942.593006:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246638592 00000100:00100000:1.0:1789762942.593034:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:1.0:1789762942.593040:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12390:x1876702246638592:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:3.0:1789762942.594875:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12390:x1876702246638592:12345-192.168.203.36@tcp:37:rm.0 Request processed in 1832us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762942.594885:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:2.0:1789762942.596138:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762942.596186:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246638848 00000100:00100000:3.0:1789762942.596192:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246638848 00000100:00100000:3.0:1789762942.596218:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:3.0:1789762942.596225:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12390:x1876702246638848:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762942.596312:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12390:x1876702246638848:12345-192.168.203.36@tcp:35:rm.0 Request processed in 87us (176us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789762942.596318:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:1.0:1789762942.597183:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762942.597221:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246639104 00000100:00100000:0.0:1789762942.597226:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246639104 00000100:00100000:0.0:1789762942.597255:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:0.0:1789762942.597262:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12390:x1876702246639104:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1789762942.597271:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762942.597279:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b1c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894485c expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.597326:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b1cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.597336:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b1cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.597352:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b1cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762942.597360:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00010000:00010000:0.0:1789762942.597405:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b1c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894485c expref: 15 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.597415:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b1cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894485c expref: 14 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762942.597420:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:0.0:1789762942.597422:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789762942.597424:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767d400, rc 0) 00000100:00100000:0.0:1789762942.597451:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12390:x1876702246639104:12345-192.168.203.36@tcp:101:rm.0 Request processed in 190us (268us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789762942.597456:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:1.0:1789762942.598397:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762942.598441:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246639232 00000100:00100000:2.0:1789762942.598447:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246639232 00000100:00100000:2.0:1789762942.598477:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1789762942.598484:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12390:x1876702246639232:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:2.0:1789762942.598512:0:12191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7741431808 avail 7278387200 00000100:00100000:2.0:1789762942.598543:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12390:x1876702246639232:12345-192.168.203.36@tcp:41:rm.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762942.598548:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1789762942.599394:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762942.599432:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246639488 00000100:00100000:3.0:1789762942.599437:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246639488 00000100:00100000:3.0:1789762942.599462:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:3.0:1789762942.599467:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12390:x1876702246639488:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762942.599543:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12390:x1876702246639488:12345-192.168.203.36@tcp:35:rm.0 Request processed in 75us (149us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789762942.599548:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1789762942.600334:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762942.600373:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246639744 00000100:00100000:2.0:1789762942.600378:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246639744 00000100:00100000:2.0:1789762942.600404:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:2.0:1789762942.600410:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12390:x1876702246639744:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762942.600432:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762942.600461:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5aed4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944840 expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600474:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5abee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944839 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600481:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9b33fec92800) 00010000:00010000:2.0:1789762942.600489:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68c00/0x5915dfb1c1b5b1b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894484e expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600495:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762942.600497:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762942.600507:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600513:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600518:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600536:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600550:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600556:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600631:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600638:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600643:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762942.600811:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8832 00000004:00080000:2.0:1789762942.600819:0:5926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 245038067089ns, next at 246038065642ns, rc = 0 00010000:00010000:2.0:1789762942.600843:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600849:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600855:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600860:0:5926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600865:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600877:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600892:0:5926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762942.600906:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600913:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.600917:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762942.600925:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.600926:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600944:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762942.600945:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762942.600952:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.600953:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.600964:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600977:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.600981:0:6926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9b33ed2aa100) 00010000:00010000:1.0:1789762942.600985:0:6926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789762942.600988:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.600993:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9b33ed2aa100) 00010000:00010000:2.0:1789762942.600999:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762942.601003:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.601006:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22e00/0x5915dfb1c1b5b1f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.601011:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b1eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762942.601021:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762942.601024:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762942.601026:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762942.601034:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.601039:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.601049:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.601053:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762942.601055:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.601059:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.601064:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762942.601066:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762942.601067:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.601071:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b1dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762942.601077:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4ac90b4 reply state 000000001152ae61 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762942.601088:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762942.601121:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12390:x1876702246639744:12345-192.168.203.36@tcp:36:rm.0 Request processed in 711us (788us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789762942.601127:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 192 00010000:00010000:3.0:1789762942.601624:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.601635:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.601643:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.601650:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762942.601654:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.601662:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.601672:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x4009f790 (ffff9b33ed2aae00) 00010000:00010000:3.0:1789762942.601675:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762942.601679:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.601685:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b1e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762942.602116:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762942.602147:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246640000 00000100:00100000:3.0:1789762942.602191:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246640000 00000100:00100000:3.0:1789762942.602225:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:3.0:1789762942.602234:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:12390:x1876702246640000:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762942.602323:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12390:x1876702246640000:12345-192.168.203.36@tcp:35:rm.0 Request processed in 90us (206us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1789762942.602331:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:1.0:1789762942.602963:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762942.602992:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246640256 00000100:00100000:2.0:1789762942.602996:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246640256 00000100:00100000:2.0:1789762942.603020:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:2.0:1789762942.603026:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12390:x1876702246640256:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762942.603054:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762942.603063:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b1cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894485c expref: 14 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603074:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b32c3054400/0x5915dfb1c1b5abd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944832 expref: 13 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603081:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2a9200) 00010000:00010000:2.0:1789762942.603088:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5ab70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894481d expref: 12 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603093:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92500) 00010000:00010000:2.0:1789762942.603097:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762942.603105:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603111:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603116:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603123:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603128:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603132:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603168:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603175:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603179:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762942.603256:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1b:0x0]: returning size 4096 00010000:00010000:2.0:1789762942.603263:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603267:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603272:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603275:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762942.603277:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603281:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603287:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff9b33ed2aad00) 00010000:00010000:2.0:1789762942.603288:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762942.603290:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603303:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23600/0x5915dfb1c1b5b207 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603320:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603327:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603334:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603340:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762942.603344:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603351:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603359:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aaa00) 00010000:00010000:2.0:1789762942.603361:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762942.603363:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762942.603367:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22200/0x5915dfb1c1b5b1f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762942.603375:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000503b3b2f reply state 0000000088068115 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762942.603379:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762942.603417:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:12390:x1876702246640256:12345-192.168.203.36@tcp:36:rm.0 Request processed in 391us (454us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789762942.603422:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 193 00010000:00010000:3.0:1789762942.603884:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.603894:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.603901:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.603907:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762942.603911:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.603918:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.603927:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2aa700) 00010000:00010000:3.0:1789762942.603930:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762942.603933:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762942.603940:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b200 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762942.778879:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254930688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762942.778942:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762942.778986:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930688 00000100:00100000:0.0:1789762942.778993:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930688 00000100:00100000:0.0:1789762942.779056:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789762942.779056:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762942.779069:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254930688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762942.779104:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:0.0:1789762942.779167:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254930688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762942.779177:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789762942.779217:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254930688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762942.842874:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789762943.292645:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967634 is committed 00000004:00080000:2.0:1789762943.431391:0:13994:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 245868637618ns, next at 246038065642ns, rc = 0 00080000:00080000:2.0:1789762943.431405:0:13994:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789762943.432378:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000001:00080000:1.0:1789762943.432396:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:1.0:1789762943.432405:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000100:00100000:1.0:1789762943.432539:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254930816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789762943.432618:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762943.432652:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930816 00000100:00100000:0.0:1789762943.432660:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930816 00000100:00100000:0.0:1789762943.432703:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789762943.432718:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254930816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789762943.432743:0:6912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:10 count 1 00002000:00010000:0.0:1789762943.432798:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 104857600, mtime: 0x6aad9d75, atime: 0x0, ctime: 0x6aad9d75, blocks: 0x32000 00010000:00010000:0.0:1789762943.432805:0:6912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.432818:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=245s v=(0 0) 00010000:00010000:0.0:1789762943.432821:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762943.432825:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.432835:0:6912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.432842:0:6912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.432847:0:6912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762943.432861:0:6912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762943.432879:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762943.432889:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.432902:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762943.432908:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.432920:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.432941:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.432948:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b20e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762943.432964:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762943.432966:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762943.432967:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762943.432983:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254930816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 267us (364us total) trans 4294967635 rc 0/0 00000100:00100000:0.0:1789762943.432989:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789762943.433013:0:3419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967634 gen 2 00000004:00080000:1.0:1789762943.433018:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c6cf9180, transno 4294967634 00000100:00100000:1.0:1789762943.433031:0:3419:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b33f7649880 x1876702254930816/t4294967635(4294967635) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762959 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789762943.433040:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b33f7649880/2, rc 0, transno 4294967635 00000100:00100000:1.0:1789762943.433048:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254930816:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789762943.433159:0:13994:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 245870406532ns, next at 233928094744ns, rc = 0 00080000:00080000:0.0:1789762943.433167:0:13994:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789762943.433663:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00010000:00010000:2.0:1789762943.866885:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762944.890895:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762945.850943:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254931072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762945.850956:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254930944:0@lo:400:kworker.0 00000100:00100000:1.0:1789762945.850975:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f749ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254931328:0@lo:400:kworker.0 00000100:00100000:2.0:1789762945.851016:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254931200:0@lo:400:kworker.0 00000100:00100000:0.0:1789762945.851080:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762945.851081:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762945.851082:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762945.851128:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931072 00000100:00100000:2.0:1789762945.851144:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931072 00000100:00100000:0.0:1789762945.851186:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f749c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254931584:0@lo:400:kworker.0 00000100:00100000:3.0:1789762945.851188:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f749e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254931456:0@lo:400:kworker.0 00000100:00080000:1.0:1789762945.851191:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762945.851207:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762945.851226:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789762945.851255:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762945.851255:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254931072:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762945.851262:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762945.851264:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f749fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254931712:0@lo:400:kworker.0 00002000:00000024:2.0:1789762945.851290:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 24519232 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762945.851297:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931328 00000100:00100000:0.0:1789762945.851303:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931328 00000100:00100000:1.0:1789762945.851307:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762945.851338:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254930944 00000100:00100000:3.0:1789762945.851345:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254930944 00000100:00100000:0.0:1789762945.851366:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931200 00000100:00100000:1.0:1789762945.851366:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931584 00000100:00100000:0.0:1789762945.851372:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931200 00000100:00100000:2.0:1789762945.851372:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254931072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.851374:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931584 00000100:00100000:2.0:1789762945.851396:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789762945.851401:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789762945.851413:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254930944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762945.851419:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789762945.851426:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789762945.851431:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762945.851437:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254931200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762945.851457:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789762945.851473:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254931584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762945.851474:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254930944:12345-0@lo:400:kworker.0 Request processed in 61us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762945.851488:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789762945.851500:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254931328:12345-0@lo:400:kworker.0 Request processed in 74us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.851506:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254931200:12345-0@lo:400:kworker.0 Request processed in 70us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762945.851526:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789762945.851533:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789762945.851541:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254931584:12345-0@lo:400:kworker.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762945.851552:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789762945.851571:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931456 00000100:00100000:0.0:1789762945.851576:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931456 00000100:00100000:1.0:1789762945.851582:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931712 00000100:00100000:1.0:1789762945.851598:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931712 00000100:00100000:3.0:1789762945.851603:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254930944:0@lo:400:kworker.0 00000100:00100000:0.0:1789762945.851633:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789762945.851640:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789762945.851645:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254931456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762945.851654:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254931712:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762945.851670:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762945.851676:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762945.851679:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f749ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254931328:0@lo:400:kworker.0 00000100:00100000:1.0:1789762945.851702:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254931200:0@lo:400:kworker.0 00000100:00100000:0.0:1789762945.851716:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254931456:12345-0@lo:400:kworker.0 Request processed in 73us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762945.851721:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254931712:12345-0@lo:400:kworker.0 Request processed in 68us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762945.851723:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f749fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254931712:0@lo:400:kworker.0 00000100:00100000:0.0:1789762945.851732:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789762945.851737:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f749e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254931456:0@lo:400:kworker.0 00000100:00100000:3.0:1789762945.851740:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789762945.851807:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f749c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254931584:0@lo:400:kworker.0 00000100:00100000:0.0:1789762945.851819:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254931072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789762945.914853:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762946.436093:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762946.436137:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246640512 00000100:00100000:1.0:1789762946.436139:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762946.436150:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246640512 00000100:00100000:3.0:1789762946.436193:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246640384 00000100:00100000:1.0:1789762946.436194:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762946.436202:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246640384 00000100:00100000:1.0:1789762946.436232:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762946.436241:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:3.0:1789762946.436255:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 271 00000100:00100000:0.0:1789762946.436260:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246640512:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762946.436271:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762946.436273:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246640384:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762946.436294:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246640768 00000100:00100000:1.0:1789762946.436305:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246640768 00000100:00100000:1.0:1789762946.436342:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246640640 00000100:00100000:3.0:1789762946.436346:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2356:x1876702246640384:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762946.436347:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246640640 00000100:00100000:0.0:1789762946.436348:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246640512:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762946.436359:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 271 00000100:00100000:0.0:1789762946.436369:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:1.0:1789762946.436375:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:1.0:1789762946.436384:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246640768:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762946.436391:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246640896 00000100:00100000:0.0:1789762946.436396:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246640896 00000100:00100000:1.0:1789762946.436420:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246640768:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 37us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762946.436427:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:0.0:1789762946.436435:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:0.0:1789762946.436445:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246640896:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762946.436449:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:1.0:1789762946.436459:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246640640:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762946.436481:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246640896:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762946.436487:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:1.0:1789762946.436500:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246640640:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762946.436507:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00080000:0.0:1789762946.436531:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762946.436536:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762946.436540:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789762946.938913:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762947.898895:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789762947.898919:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254931840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762947.898975:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762947.899013:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931840 00000100:00100000:0.0:1789762947.899021:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931840 00000100:00080000:1.0:1789762947.899070:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762947.899079:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789762947.899089:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254931840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762947.899114:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762947.899156:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254931840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762947.899161:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789762947.899208:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254931840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789762947.962901:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762948.986849:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789762949.435913:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967635 is committed 00010000:00010000:1.0:1789762950.010884:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762950.970913:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254931968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762950.970926:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254932096:0@lo:400:kworker.0 00000100:00100000:1.0:1789762950.970953:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254932352:0@lo:400:kworker.0 00000100:00100000:3.0:1789762950.970982:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254932224:0@lo:400:kworker.0 00000100:00100000:2.0:1789762950.971001:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762950.971007:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762950.971043:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762950.971050:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254931968 00000100:00100000:3.0:1789762950.971057:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254931968 00000100:00100000:2.0:1789762950.971082:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254932480:0@lo:400:kworker.0 00000100:00100000:0.0:1789762950.971087:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c6b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254932608:0@lo:400:kworker.0 00000100:00080000:1.0:1789762950.971094:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762950.971113:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789762950.971122:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762950.971127:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932096 00000100:00100000:3.0:1789762950.971129:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ee1e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254931968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762950.971132:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762950.971134:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932096 00002000:00000024:3.0:1789762950.971161:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 24519232 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789762950.971183:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932352 00000100:00100000:0.0:1789762950.971191:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932608 00000100:00100000:1.0:1789762950.971191:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789762950.971191:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932352 00000100:00100000:0.0:1789762950.971199:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932608 00000100:00100000:1.0:1789762950.971206:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254932096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762950.971240:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ee1e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254931968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762950.971248:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789762950.971252:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789762950.971259:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254932096:12345-0@lo:400:kworker.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762950.971264:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789762950.971266:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254932352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762950.971272:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789762950.971297:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254932608:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762950.971331:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762950.971332:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254932352:12345-0@lo:400:kworker.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762950.971347:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789762950.971352:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254932608:12345-0@lo:400:kworker.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762950.971360:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789762950.971393:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c6b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254932608:0@lo:400:kworker.0 00000100:00100000:2.0:1789762950.971408:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254932352:0@lo:400:kworker.0 00000100:00100000:1.0:1789762950.971417:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254932096:0@lo:400:kworker.0 00000100:00100000:0.0:1789762950.971427:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932480 00000100:00100000:0.0:1789762950.971432:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932480 00000100:00100000:2.0:1789762950.971467:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254931968:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789762950.971473:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762950.971480:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789762950.971488:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254932480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762950.971508:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762950.971562:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c243ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254932736:0@lo:400:kworker.0 00000100:00100000:0.0:1789762950.971566:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254932480:12345-0@lo:400:kworker.0 Request processed in 74us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762950.971572:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932224 00000100:00100000:0.0:1789762950.971578:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789762950.971578:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932224 00000100:00100000:2.0:1789762950.971592:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762950.971605:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932736 00000100:00100000:3.0:1789762950.971608:0:3420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967635 gen 2 00000100:00100000:0.0:1789762950.971610:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932736 00000004:00080000:3.0:1789762950.971615:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b33f7649880, transno 4294967635 00000100:00100000:1.0:1789762950.971621:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789762950.971629:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254932224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762950.971643:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254932480:0@lo:400:kworker.0 00000100:00100000:0.0:1789762950.971655:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789762950.971667:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254932736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762950.971684:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254932224:12345-0@lo:400:kworker.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762950.971691:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789762950.971702:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254932224:0@lo:400:kworker.0 00000100:00100000:0.0:1789762950.971709:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254932736:12345-0@lo:400:kworker.0 Request processed in 45us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762950.971715:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789762950.971726:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c243ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254932736:0@lo:400:kworker.0 00010000:00010000:2.0:1789762951.034930:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762951.555703:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762951.555746:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762951.555780:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246641024 00000100:00100000:3.0:1789762951.555790:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246641024 00000100:00100000:0.0:1789762951.555805:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246641152 00000100:00100000:2.0:1789762951.555811:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762951.555813:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246641152 00000100:00100000:3.0:1789762951.555839:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 273 00000100:00100000:2.0:1789762951.555840:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762951.555855:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246641024:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762951.555869:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:2.0:1789762951.555876:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762951.555882:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246641152:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762951.555938:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246641024:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762951.555940:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246641152:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762951.555945:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246641280 00000100:00100000:2.0:1789762951.555951:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246641280 00000100:00100000:3.0:1789762951.555955:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 273 00000100:00100000:0.0:1789762951.555959:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:0.0:1789762951.555982:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246641536 00000100:00100000:0.0:1789762951.555992:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246641536 00000100:00100000:2.0:1789762951.555993:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246641408 00000100:00100000:2.0:1789762951.555999:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246641408 00000100:00100000:0.0:1789762951.556027:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:0.0:1789762951.556047:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246641536:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762951.556054:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:2.0:1789762951.556066:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246641280:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762951.556086:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246641536:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762951.556091:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:2.0:1789762951.556110:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246641280:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762951.556119:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:2.0:1789762951.556139:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:2.0:1789762951.556156:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246641408:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:0.0:1789762951.556169:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762951.556174:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789762951.556177:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762951.556200:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246641408:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762951.556209:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 101 00010000:00010000:0.0:1789762952.059854:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789762952.473682:0:14450:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789762952.473691:0:14450:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:2.0:1789762952.508294:0:14470:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789762952.508300:0:14470:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789762952.895360:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762952.895378:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:3.0:1789762952.895390:0:14523:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762952.895396:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762952.895516:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:3.0:1789762952.895523:0:14523:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f73f2500 rate 20 gen 0 00000100:00100000:3.0:1789762952.895527:0:14523:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762952.895574:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762952.895583:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_write 00000100:00100000:3.0:1789762952.895586:0:14523:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f73f2000 rate 20 gen 0 00000100:00100000:3.0:1789762952.895715:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762952.895847:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:3.0:1789762952.895853:0:14523:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762952.895858:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762952.895865:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:3.0:1789762952.895868:0:14523:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f73f2900 rate 10 gen 0 00000100:00100000:3.0:1789762952.895871:0:14523:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762952.895874:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762952.895880:0:14523:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: opcode, str: ost_read 00000100:00100000:3.0:1789762952.895882:0:14523:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f73f2700 rate 10 gen 0 00000100:00100000:1.0:1789762952.910230:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762952.910277:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246641664 00000100:00100000:0.0:1789762952.910287:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246641664 00000100:00100000:0.0:1789762952.910338:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:0.0:1789762952.910347:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:12894:x1876702246641664:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:0.0:1789762952.910365:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762952.910429:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944863 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.910491:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b21c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.910503:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b21c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.910530:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b21c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762952.910573:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762952.910579:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762952.910607:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b21c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.910629:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944863 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.910641:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b21c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944863 expref: 6 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.910648:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:0.0:1789762952.910651:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762952.910653:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767c200, rc 0) 00000100:00100000:0.0:1789762952.910700:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12894:x1876702246641664:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 356us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762952.910706:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:0.0:1789762952.912491:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762952.912534:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246641792 00000100:00100000:1.0:1789762952.912539:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246641792 00000100:00100000:1.0:1789762952.912590:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:1.0:1789762952.912603:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246641792:12345-192.168.203.36@tcp:41:mkdir.0 00000004:00000024:1.0:1789762952.912629:0:9183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1789762952.912667:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246641792:12345-192.168.203.36@tcp:41:mkdir.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762952.912673:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:3.0:1789762952.912823:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762952.912843:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246642048 00000100:00100000:0.0:1789762952.912849:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246642048 00000100:00100000:0.0:1789762952.912880:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:0.0:1789762952.912887:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12894:x1876702246642048:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:0.0:1789762952.912928:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762952.912942:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b21c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944863 expref: 6 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.912952:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:0.0:1789762952.912959:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762952.912998:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913018:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913024:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913033:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913038:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913043:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762952.913478:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00010000:00010000:0.0:1789762952.913486:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913491:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913496:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913500:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767de00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762952.913503:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913525:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913541:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d300) 00010000:00010000:0.0:1789762952.913543:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762952.913547:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.913551:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b223 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762952.913572:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003affaa2 reply state 000000003ec07c88 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.913578:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762952.913620:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12894:x1876702246642048:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 733us (799us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789762952.913625:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 196 00010000:00010000:3.0:1789762952.914280:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.914289:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.914294:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.914299:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762952.914301:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.914323:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.914331:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d000) 00010000:00010000:3.0:1789762952.914333:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762952.914335:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.914339:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b22a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762952.920425:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762952.920470:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246642176 00000100:00100000:1.0:1789762952.920478:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246642176 00000100:00100000:1.0:1789762952.920528:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:1.0:1789762952.920536:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12895:x1876702246642176:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762952.920550:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762952.920575:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69a00/0x5915dfb1c1b5b231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894486a expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.920620:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.920628:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.920635:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762952.920654:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762952.920657:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762952.920668:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.920683:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69a00/0x5915dfb1c1b5b231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894486a expref: 8 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.920693:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894486a expref: 7 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.920699:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535a00) 00010000:00010000:1.0:1789762952.920701:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762952.920703:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec69000, rc 0) 00000100:00100000:1.0:1789762952.920733:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12895:x1876702246642176:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 198us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762952.920738:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:0.0:1789762952.921985:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762952.922032:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246642432 00000100:00100000:1.0:1789762952.922038:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246642432 00000100:00100000:1.0:1789762952.922074:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:1.0:1789762952.922081:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12895:x1876702246642432:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762952.922089:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762952.922091:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789762952.922103:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894486a expref: 7 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922117:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535a00) 00010000:00010000:1.0:1789762952.922127:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762952.922136:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68a00/0x5915dfb1c1b5b23f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944871 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922192:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922201:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922207:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922216:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922221:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922227:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922258:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922269:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922274:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762952.922280:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00010000:00010000:1.0:1789762952.922289:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922295:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922300:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922303:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec69800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762952.922306:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922310:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922316:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f4535c00) 00010000:00010000:1.0:1789762952.922319:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762952.922321:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922324:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69800/0x5915dfb1c1b5b254 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922339:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922348:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922352:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922356:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec68800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762952.922358:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922362:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922367:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535900) 00010000:00010000:1.0:1789762952.922369:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762952.922371:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922375:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922383:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922387:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922391:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922394:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec69c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762952.922402:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922407:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922412:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f4535800) 00010000:00010000:1.0:1789762952.922414:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762952.922416:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922420:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b24d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922447:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68a00/0x5915dfb1c1b5b23f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944871 expref: 7 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922453:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535900) 00010000:00010000:1.0:1789762952.922454:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762952.922457:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68a00/0x5915dfb1c1b5b23f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944871 expref: 7 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.922471:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec68a00, rc 0) 00000100:00100000:1.0:1789762952.922521:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12895:x1876702246642432:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 440us (537us total) trans 0 rc 301/301 00000100:00100000:1.0:1789762952.922530:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:0.0:1789762952.923602:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762952.923637:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246642560 00000100:00100000:1.0:1789762952.923642:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246642560 00000100:00100000:1.0:1789762952.923670:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:1.0:1789762952.923677:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12895:x1876702246642560:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762952.923689:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762952.923708:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b25b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944878 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.923732:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68400/0x5915dfb1c1b5b262 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.923739:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68400/0x5915dfb1c1b5b262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.923745:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68400/0x5915dfb1c1b5b262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762952.923778:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762952.923781:0:7598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762952.923788:0:7598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68400/0x5915dfb1c1b5b262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.923801:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b25b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944878 expref: 8 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.923810:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68400/0x5915dfb1c1b5b262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944878 expref: 7 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.923815:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:1.0:1789762952.923816:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762952.923818:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec68400, rc 0) 00000100:00100000:1.0:1789762952.923843:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12895:x1876702246642560:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 167us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762952.923848:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:3.0:1789762952.924910:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762952.924951:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246642816 00000100:00100000:0.0:1789762952.924958:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246642816 00000100:00100000:0.0:1789762952.924998:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:0.0:1789762952.925008:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:12895:x1876702246642816:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1789762952.925016:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762952.925025:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894487f expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925053:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925061:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925074:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925083:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925089:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925094:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762952.925129:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00010000:00010000:0.0:1789762952.925169:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925175:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925179:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925183:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767ce00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762952.925186:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925191:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925197:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:0.0:1789762952.925200:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762952.925208:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925212:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925220:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925225:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925229:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925233:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767dc00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762952.925236:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925240:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925246:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d300) 00010000:00010000:0.0:1789762952.925248:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762952.925250:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925253:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b277 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925279:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b269 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894487f expref: 9 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925296:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:0.0:1789762952.925298:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789762952.925302:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894487f expref: 9 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.925308:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767c200, rc 0) 00000100:00100000:0.0:1789762952.925340:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:12895:x1876702246642816:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 335us (432us total) trans 4294967448 rc 301/301 00000100:00100000:0.0:1789762952.925345:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:0.0:1789762952.926396:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762952.926428:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246643072 00000100:00100000:1.0:1789762952.926434:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246643072 00000100:00100000:1.0:1789762952.926471:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:1.0:1789762952.926479:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:12895:x1876702246643072:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:1.0:1789762952.926521:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.926530:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.926535:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762952.926620:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7cc6ded reply state 00000000bda5ad14 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762952.926626:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762952.926629:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00000100:00100000:1.0:1789762952.926666:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12895:x1876702246643072:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 189us (270us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789762952.926672:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 201 00010000:00010000:3.0:1789762952.927320:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.927328:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.927333:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.927337:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec68e00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762952.927339:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.927343:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.927351:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f4535700) 00010000:00010000:3.0:1789762952.927360:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789762952.927363:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.927418:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68e00/0x5915dfb1c1b5b285 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.927479:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762952.927520:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246643328 00000100:00100000:1.0:1789762952.927524:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246643328 00000100:00100000:1.0:1789762952.927550:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:1.0:1789762952.927569:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:12895:x1876702246643328:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1789762952.927662:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12895:x1876702246643328:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 94us (183us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789762952.927669:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:1.0:1789762952.933548:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762952.933592:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246643456 00000100:00100000:2.0:1789762952.933599:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246643456 00000100:00100000:2.0:1789762952.933643:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:2.0:1789762952.933654:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12896:x1876702246643456:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:2.0:1789762952.933667:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762952.933682:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b28c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944886 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933728:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933741:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933782:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933802:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933810:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933827:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933895:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b2a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933904:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933914:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762952.933941:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00000004:00200000:2.0:1789762952.933945:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762952.933962:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933973:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933980:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933986:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933991:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22c00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762952.933994:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.933999:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934015:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:2.0:1789762952.934017:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762952.934022:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934029:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22c00/0x5915dfb1c1b5b293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934040:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934047:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934054:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934061:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762952.934065:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934072:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934080:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2aad00) 00010000:00010000:2.0:1789762952.934082:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762952.934084:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934088:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23a00/0x5915dfb1c1b5b29a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934135:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b28c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944886 expref: 12 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934155:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944886 expref: 11 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762952.934164:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33ed2aa100) 00010000:00010000:2.0:1789762952.934166:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762952.934169:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ffd23000, rc 0) 00000100:00100000:2.0:1789762952.934211:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12896:x1876702246643456:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 561us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762952.934217:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:3.0:1789762952.935565:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762952.935606:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246643712 00000100:00100000:1.0:1789762952.935612:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246643712 00000100:00100000:1.0:1789762952.935655:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:1.0:1789762952.935665:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12896:x1876702246643712:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:1.0:1789762952.935690:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762952.935706:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b2a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944886 expref: 11 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.935718:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33ed2aa100) 00010000:00010000:1.0:1789762952.935726:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762952.935741:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.935773:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762952.935781:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762952.935875:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064e5e855 reply state 000000000814b71a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762952.935886:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789762952.935891:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00000100:00100000:1.0:1789762952.935940:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12896:x1876702246643712:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 277us (376us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789762952.935946:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 203 00010000:00010000:0.0:1789762952.936650:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.936660:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.936665:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.936670:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec68000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762952.936672:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.936677:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.936685:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f4535900) 00010000:00010000:0.0:1789762952.936693:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762952.936697:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.936701:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b2a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762952.957655:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762952.957700:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246643840 00000100:00100000:0.0:1789762952.957709:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246643840 00000100:00100000:0.0:1789762952.957778:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:0.0:1789762952.957788:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12900:x1876702246643840:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762952.957806:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762952.957822:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b2af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894488d expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957876:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957887:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957907:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957916:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957921:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957926:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957992:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b2c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.957998:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958003:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762952.958030:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00000004:00200000:0.0:1789762952.958035:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762952.958051:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958062:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958068:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958072:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958076:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767dc00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762952.958079:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958084:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958094:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:0.0:1789762952.958104:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762952.958109:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958115:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958127:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958134:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958141:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958147:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767ce00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762952.958150:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958156:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958165:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d300) 00010000:00010000:0.0:1789762952.958168:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762952.958171:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958178:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b2bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958206:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b2af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894488d expref: 13 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958227:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894488d expref: 12 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.958232:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:0.0:1789762952.958234:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762952.958236:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767c800, rc 0) 00000100:00100000:0.0:1789762952.958276:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12900:x1876702246643840:12345-192.168.203.36@tcp:101:dd.0 Request processed in 491us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762952.958282:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:1.0:1789762952.959688:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762952.959734:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246644096 00000100:00100000:0.0:1789762952.959739:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246644096 00000100:00100000:0.0:1789762952.959801:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:0.0:1789762952.959812:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12900:x1876702246644096:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762952.959823:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762952.959832:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ca00/0x5915dfb1c1b5b2cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944894 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.959889:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.959900:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.959907:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.959918:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.959933:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.959940:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789762952.960185:0:7598:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb:0x0], index 0: 0 00000004:00080000:0.0:1789762952.960190:0:7598:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9:0x0], index 1: 0 00010000:00010000:0.0:1789762952.960279:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b2e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960286:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960292:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960311:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960316:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960321:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960324:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762952.960326:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960330:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960342:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:0.0:1789762952.960344:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762952.960347:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960351:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b2d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762952.960358:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a83063dd reply state 00000000294f5e32 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762952.960364:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789762952.960380:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ca00/0x5915dfb1c1b5b2cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944894 expref: 15 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960388:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944894 expref: 14 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.960394:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:0.0:1789762952.960395:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762952.960397:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767d600, rc 0) 00000100:00100000:0.0:1789762952.960428:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12900:x1876702246644096:12345-192.168.203.36@tcp:101:dd.0 Request processed in 620us (742us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789762952.960432:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 205 00010000:00010000:3.0:1789762952.960949:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.960958:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.960963:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.960966:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762952.960969:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.960973:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.960981:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x3950208a (ffff9b33f721d200) 00010000:00010000:3.0:1789762952.960983:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762952.960985:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762952.960990:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b2d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762952.964229:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762952.964263:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246644224 00000100:00100000:0.0:1789762952.964268:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246644224 00000100:00100000:0.0:1789762952.964299:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:0.0:1789762952.964307:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:12900:x1876702246644224:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762952.964321:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762952.964331:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5b2ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894489b expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762952.964347:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789762952.964358:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=255s v=(0 0) 00010000:00010000:0.0:1789762952.964362:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762952.964369:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5b2ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894489b expref: 6 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.964379:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5b2ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894489b expref: 6 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762952.964387:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767d800, rc 0) 00000100:00100000:0.0:1789762952.964414:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12900:x1876702246644224:12345-192.168.203.36@tcp:101:dd.0 Request processed in 110us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762952.964420:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:1.0:1789762953.014775:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.014871:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246644480 00000100:00100000:0.0:1789762953.014880:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246644480 00000100:00080000:1.0:1789762953.014926:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762953.014933:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:0.0:1789762953.014942:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:12900:x1876702246644480:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762953.014953:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762953.014965:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b2f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448a2 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762953.014982:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789762953.015002:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=255s v=(0 0) 00010000:00010000:0.0:1789762953.015005:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.015011:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b2f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448a2 expref: 6 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.015024:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b2f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448a2 expref: 6 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.015031:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767ca00, rc 0) 00000100:00100000:0.0:1789762953.015066:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:12900:x1876702246644480:12345-192.168.203.36@tcp:101:dd.0 Request processed in 127us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762953.015071:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:3.0:1789762953.015625:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.015668:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246644352 00000100:00100000:0.0:1789762953.015673:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246644352 00002000:00100000:0.0:1789762953.015705:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xb:0x0] (0->4194303) req@ffff9b32c243d180 x1876702246644352/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1789762953.015710:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1789762953.015716:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243d180 with x1876702246644352 ext(0->4194303) 00002000:00010000:0.0:1789762953.015720:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c243d180 00000100:00100000:0.0:1789762953.015772:0:6915:0:(nrs_tbf.c:1585:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 3 deadline 0 time 255452981928 state 0x0 ref 1 00000100:00100000:0.0:1789762953.015781:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 3 deadline 255502981928 time 255452981928 state 0x1 ref 1 00000100:00100000:0.0:1789762953.015800:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255502981928 time 255453045075 state 0x0 ref 1 00000100:00100000:0.0:1789762953.015809:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246644352:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:2.0:1789762953.018888:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254932864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762953.018941:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762953.018986:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932864 00000100:00100000:0.0:1789762953.018991:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932864 00000100:00080000:1.0:1789762953.019016:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762953.019033:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789762953.019040:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254932864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762953.019061:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489136704 pending 4218880 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762953.019097:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254932864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762953.019102:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789762953.019137:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254932864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762953.029087:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246644352:12345-192.168.203.36@tcp:4:dd.0 Request processed in 13273us (13457us total) trans 4294967636 rc 0/0 00000100:00100000:0.0:1789762953.029097:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:0.0:1789762953.029107:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255502981928 time 255453045075 state 0x2 ref 0 00002000:00100000:0.0:1789762953.029120:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xb:0x0] (0->4194303) req@ffff9b32c243d180 x1876702246644352/t4294967636(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762953.029128:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243d180 with x1876702246644352 ext(0->4194303) 00002000:00010000:0.0:1789762953.029133:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c243d180 00000100:00100000:3.0:1789762953.068295:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.068350:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246644608 00000100:00100000:2.0:1789762953.068360:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246644608 00002000:00100000:2.0:1789762953.068401:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x9:0x0] (0->4194303) req@ffff9b32c243fb80 x1876702246644608/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.068411:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243fb80 with x1876702246644608 ext(0->4194303) 00002000:00010000:2.0:1789762953.068415:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c243fb80 00000100:00100000:2.0:1789762953.068430:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255502981928 time 255453045075 state 0x0 ref 1 00000100:00100000:2.0:1789762953.068441:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255503045075 time 255453045075 state 0x1 ref 1 00000100:00100000:2.0:1789762953.068475:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255503045075 time 255505719069 state 0x0 ref 1 00000100:00100000:2.0:1789762953.068484:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246644608:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:2.0:1789762953.082623:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246644608:12345-192.168.203.36@tcp:4:dd.0 Request processed in 14119us (14316us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789762953.082636:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:2.0:1789762953.082646:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255503045075 time 255505719069 state 0x2 ref 0 00002000:00100000:2.0:1789762953.082659:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x9:0x0] (0->4194303) req@ffff9b32c243fb80 x1876702246644608/t4294967332(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.082667:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243fb80 with x1876702246644608 ext(0->4194303) 00002000:00010000:2.0:1789762953.082672:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c243fb80 00010000:00010000:1.0:1789762953.082822:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762953.103368:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.103426:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246644736 00000100:00100000:1.0:1789762953.103436:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246644736 00002000:00100000:1.0:1789762953.103498:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xb:0x0] (4194304->8388607) req@ffff9b32c243c380 x1876702246644736/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789762953.103524:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243c380 with x1876702246644736 ext(4194304->8388607) 00002000:00010000:1.0:1789762953.103531:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c243c380 00000100:00100000:1.0:1789762953.103564:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255503045075 time 255505719069 state 0x0 ref 1 00000100:00100000:1.0:1789762953.103575:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255555719069 time 255505719069 state 0x1 ref 1 00000100:00100000:1.0:1789762953.103598:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255555719069 time 255540843157 state 0x0 ref 1 00000100:00100000:1.0:1789762953.103610:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246644736:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:2.0:1789762953.115918:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246644736:12345-192.168.203.36@tcp:4:dd.0 Request processed in 12304us (12549us total) trans 4294967637 rc 0/0 00000100:00100000:2.0:1789762953.115930:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:2.0:1789762953.115940:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255555719069 time 255540843157 state 0x2 ref 0 00002000:00100000:2.0:1789762953.115952:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xb:0x0] (4194304->8388607) req@ffff9b32c243c380 x1876702246644736/t4294967637(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.115960:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243c380 with x1876702246644736 ext(4194304->8388607) 00002000:00010000:2.0:1789762953.115966:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c243c380 00000100:00100000:1.0:1789762953.149806:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.149857:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246644992 00000100:00100000:3.0:1789762953.149866:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246644992 00000100:00080000:1.0:1789762953.149912:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762953.149922:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:3.0:1789762953.149933:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12900:x1876702246644992:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:3.0:1789762953.150182:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12900:x1876702246644992:12345-192.168.203.36@tcp:35:dd.0 Request processed in 250us (383us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789762953.150188:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:1.0:1789762953.151085:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.151125:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246645120 00000100:00100000:2.0:1789762953.151145:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246645120 00002000:00100000:2.0:1789762953.151182:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x9:0x0] (4194304->8388607) req@ffff9b33ff442d80 x1876702246645120/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.151190:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442d80 with x1876702246645120 ext(4194304->8388607) 00002000:00010000:2.0:1789762953.151195:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff442d80 00000100:00100000:2.0:1789762953.151207:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255555719069 time 255540843157 state 0x0 ref 1 00000100:00100000:2.0:1789762953.151217:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255590843157 time 255540843157 state 0x1 ref 1 00000100:00100000:2.0:1789762953.151238:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255590843157 time 255588482733 state 0x0 ref 1 00000100:00100000:2.0:1789762953.151246:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246645120:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762953.164671:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246645120:12345-192.168.203.36@tcp:4:dd.0 Request processed in 13418us (13579us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789762953.164683:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:0.0:1789762953.164692:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255590843157 time 255588482733 state 0x2 ref 0 00002000:00100000:0.0:1789762953.164706:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x9:0x0] (4194304->8388607) req@ffff9b33ff442d80 x1876702246645120/t4294967333(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762953.164725:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442d80 with x1876702246645120 ext(4194304->8388607) 00002000:00010000:0.0:1789762953.164730:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff442d80 00000100:00100000:2.0:1789762953.187443:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.187498:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246645376 00000100:00100000:3.0:1789762953.187520:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246645376 00000100:00100000:3.0:1789762953.187576:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:3.0:1789762953.187590:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12910:x1876702246645376:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762953.187613:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762953.187631:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ce00/0x5915dfb1c1b5b2fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.187717:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.187729:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.187737:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.187907:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.187917:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.187924:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762953.188170:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa:0x0], index 1: 0 00000004:00080000:2.0:1789762953.188175:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc:0x0], index 0: 0 00010000:00010000:2.0:1789762953.188274:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188281:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188293:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188318:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188324:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188328:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188332:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82de00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762953.188335:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188341:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188349:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:2.0:1789762953.188351:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762953.188354:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188358:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82de00/0x5915dfb1c1b5b303 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762953.188366:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083dda50c reply state 00000000fbdac991 transno 4294967454 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.188372:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762953.188405:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ce00/0x5915dfb1c1b5b2fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448a9 expref: 18 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188415:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448a9 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.188420:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9b33ed2aa000) 00010000:00010000:2.0:1789762953.188422:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762953.188424:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ffd22400, rc 0) 00000100:00100000:2.0:1789762953.188468:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:12910:x1876702246645376:12345-192.168.203.36@tcp:101:dd.0 Request processed in 883us (1031us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789762953.188473:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 206 00010000:00010000:0.0:1789762953.189035:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.189043:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.189048:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.189052:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.189055:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.189059:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.189066:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x25a23cf0 (ffff9b33ed2aad00) 00010000:00010000:0.0:1789762953.189068:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.189070:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.189074:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22800/0x5915dfb1c1b5b30a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.194925:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.195008:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246645504 00000100:00100000:3.0:1789762953.195015:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246645504 00000100:00100000:3.0:1789762953.195054:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:3.0:1789762953.195064:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12910:x1876702246645504:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762953.195073:0:12943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762953.195084:0:12943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448b0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762953.195101:0:12943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789762953.195112:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=255s v=(0 0) 00010000:00010000:3.0:1789762953.195116:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762953.195123:0:12943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 11 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.195133:0:12943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 11 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.195141:0:12943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82c400, rc 0) 00000100:00100000:3.0:1789762953.195169:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12910:x1876702246645504:12345-192.168.203.36@tcp:101:dd.0 Request processed in 108us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762953.195173:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:2.0:1789762953.202805:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.202852:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246645632 00000100:00100000:3.0:1789762953.202859:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246645632 00000100:00100000:3.0:1789762953.202893:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:3.0:1789762953.202900:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12915:x1876702246645632:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762953.202917:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762953.202927:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b326 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448b7 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762953.202942:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789762953.202952:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=255s v=(0 0) 00010000:00010000:3.0:1789762953.202955:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762953.202963:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b7 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.202977:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b7 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.202988:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82d800, rc 0) 00000100:00100000:3.0:1789762953.203025:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:12915:x1876702246645632:12345-192.168.203.36@tcp:101:dd.0 Request processed in 124us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762953.203033:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:1.0:1789762953.250344:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.250409:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246645760 00000100:00100000:2.0:1789762953.250421:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246645760 00000100:00100000:2.0:1789762953.250487:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:2.0:1789762953.250496:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:5888:x1876702246645760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762953.250523:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789762953.250541:0:7992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789762953.250545:0:7992:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1789762953 00002000:00010000:2.0:1789762953.250548:0:7992:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1789762953 00002000:00010000:2.0:1789762953.250550:0:7992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:2.0:1789762953.250575:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5b2ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894489b expref: 11 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.250600:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762953.250655:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:5888:x1876702246645760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 161us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762953.250662:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:2.0:1789762953.255565:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.255611:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246645888 00000100:00100000:0.0:1789762953.255617:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246645888 00000100:00100000:0.0:1789762953.255652:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1789762953.255658:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:5430:x1876702246645888:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762953.255673:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789762953.255682:0:5910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789762953.255685:0:5910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1789762953 00002000:00010000:0.0:1789762953.255687:0:5910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1789762953 00002000:00010000:0.0:1789762953.255689:0:5910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:0.0:1789762953.255701:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b2f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448a2 expref: 11 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.255715:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762953.255742:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:5430:x1876702246645888:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762953.255748:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:1.0:1789762953.390955:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.391018:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246646016 00000100:00100000:0.0:1789762953.391030:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246646016 00002000:00100000:0.0:1789762953.391081:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa:0x0] (0->4194303) req@ffff9b33ff442680 x1876702246646016/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762953.391090:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442680 with x1876702246646016 ext(0->4194303) 00002000:00010000:0.0:1789762953.391096:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff442680 00000100:00100000:0.0:1789762953.391110:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255590843157 time 255588482733 state 0x0 ref 1 00000100:00100000:0.0:1789762953.391121:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255638482733 time 255588482733 state 0x1 ref 1 00000100:00100000:0.0:1789762953.391149:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255638482733 time 255828394165 state 0x0 ref 1 00000100:00100000:0.0:1789762953.391167:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246646016:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:0.0:1789762953.407465:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246646016:12345-192.168.203.36@tcp:4:dd.0 Request processed in 16292us (16511us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789762953.407476:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:0.0:1789762953.407486:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255638482733 time 255828394165 state 0x2 ref 0 00002000:00100000:0.0:1789762953.407498:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa:0x0] (0->4194303) req@ffff9b33ff442680 x1876702246646016/t4294967334(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762953.407516:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff442680 with x1876702246646016 ext(0->4194303) 00002000:00010000:0.0:1789762953.407522:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff442680 00000100:00100000:2.0:1789762953.407843:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.407887:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246646272 00000100:00100000:1.0:1789762953.407895:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246646272 00000100:00100000:1.0:1789762953.407935:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:1.0:1789762953.407944:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:12946:x1876702246646272:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762953.407977:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.407996:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b32d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448be expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.408085:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.408096:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.408105:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762953.408113:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:1.0:1789762953.408173:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69c00/0x5915dfb1c1b5b32d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448be expref: 20 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.408187:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448be expref: 19 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.408193:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:1.0:1789762953.408195:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762953.408197:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec68000, rc 0) 00000100:00100000:1.0:1789762953.408226:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:12946:x1876702246646272:12345-192.168.203.36@tcp:101:dd.0 Request processed in 285us (386us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789762953.408231:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:1.0:1789762953.414683:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.414736:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246646400 00000100:00100000:2.0:1789762953.414741:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246646400 00002000:00100000:2.0:1789762953.414784:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc:0x0] (4194304->8388607) req@ffff9b33ff443b80 x1876702246646400/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.414792:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff443b80 with x1876702246646400 ext(4194304->8388607) 00002000:00010000:2.0:1789762953.414796:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ff443b80 00000100:00100000:2.0:1789762953.414806:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255638482733 time 255828394165 state 0x0 ref 1 00000100:00100000:2.0:1789762953.414815:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255878394165 time 255828394165 state 0x1 ref 1 00000100:00100000:2.0:1789762953.414837:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255878394165 time 255852081893 state 0x0 ref 1 00000100:00100000:2.0:1789762953.414844:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246646400:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:2.0:1789762953.420296:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.420344:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246646912 00000100:00100000:0.0:1789762953.420350:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246646912 00000100:00100000:0.0:1789762953.420390:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:0.0:1789762953.420400:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:12945:x1876702246646912:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762953.420411:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762953.420426:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ca00/0x5915dfb1c1b5b342 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448cc expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.420499:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.420523:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.420531:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.420539:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:0.0:1789762953.420611:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ca00/0x5915dfb1c1b5b342 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448cc expref: 22 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.420623:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448cc expref: 21 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.420630:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:0.0:1789762953.420633:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789762953.420635:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767d000, rc 0) 00000100:00100000:0.0:1789762953.420673:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:12945:x1876702246646912:12345-192.168.203.36@tcp:101:dd.0 Request processed in 276us (380us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789762953.420679:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:2.0:1789762953.423094:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.423145:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246647168 00000100:00100000:0.0:1789762953.423152:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246647168 00000100:00100000:0.0:1789762953.423209:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:0.0:1789762953.423228:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:12952:x1876702246647168:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762953.423241:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762953.423255:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448d3 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.423308:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b35e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.423320:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b35e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.423328:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b35e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.423351:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:0.0:1789762953.423414:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c200/0x5915dfb1c1b5b357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448d3 expref: 24 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.423431:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b35e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448d3 expref: 23 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.423439:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:0.0:1789762953.423442:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789762953.423444:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767ce00, rc 0) 00000100:00100000:0.0:1789762953.423484:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:12952:x1876702246647168:12345-192.168.203.36@tcp:101:dd.0 Request processed in 267us (394us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789762953.423492:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:1.0:1789762953.424908:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.424941:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246647424 00000100:00100000:0.0:1789762953.424946:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246647424 00000100:00100000:0.0:1789762953.424974:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:0.0:1789762953.424987:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:12956:x1876702246647424:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762953.424995:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762953.425003:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b36c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448da expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.425051:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767cc00/0x5915dfb1c1b5b373 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.425071:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767cc00/0x5915dfb1c1b5b373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.425087:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767cc00/0x5915dfb1c1b5b373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.425095:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:0.0:1789762953.425136:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767dc00/0x5915dfb1c1b5b36c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448da expref: 26 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.425146:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767cc00/0x5915dfb1c1b5b373 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448da expref: 25 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.425152:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:0.0:1789762953.425154:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789762953.425156:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767cc00, rc 0) 00000100:00100000:0.0:1789762953.425182:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:12956:x1876702246647424:12345-192.168.203.36@tcp:101:dd.0 Request processed in 196us (276us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789762953.425187:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:2.0:1789762953.426262:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2354:x1876702246646400:12345-192.168.203.36@tcp:4:dd.0 Request processed in 11416us (11578us total) trans 4294967638 rc 0/0 00000100:00100000:2.0:1789762953.426271:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:2.0:1789762953.426281:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255878394165 time 255852081893 state 0x2 ref 0 00002000:00100000:2.0:1789762953.426302:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc:0x0] (4194304->8388607) req@ffff9b33ff443b80 x1876702246646400/t4294967638(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.426310:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff443b80 with x1876702246646400 ext(4194304->8388607) 00002000:00010000:2.0:1789762953.426314:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ff443b80 00000100:00100000:1.0:1789762953.428032:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.428083:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246647808 00000100:00100000:2.0:1789762953.428090:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246647808 00000100:00100000:2.0:1789762953.428129:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:2.0:1789762953.428138:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+25:12947:x1876702246647808:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762953.428147:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762953.428155:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b381 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448e1 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.428196:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b388 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.428204:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.428210:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762953.428216:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:2.0:1789762953.428257:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23800/0x5915dfb1c1b5b381 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e1 expref: 28 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.428268:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b388 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e1 expref: 27 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.428283:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:2.0:1789762953.428285:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762953.428288:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ffd23e00, rc 0) 00000100:00100000:2.0:1789762953.428317:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:12947:x1876702246647808:12345-192.168.203.36@tcp:101:dd.0 Request processed in 181us (286us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789762953.428322:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:1.0:1789762953.429366:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.429408:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246647552 00000100:00100000:2.0:1789762953.429414:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246647552 00000100:00100000:1.0:1789762953.429418:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00002000:00100000:2.0:1789762953.429441:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4194303) req@ffff9b33ff440e00 x1876702246647552/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.429450:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff440e00 with x1876702246647552 ext(0->4194303) 00002000:00010000:2.0:1789762953.429453:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ff440e00 00000100:00100000:2.0:1789762953.429466:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255878394165 time 255852081893 state 0x0 ref 1 00000100:00100000:2.0:1789762953.429481:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 255902081893 time 255852081893 state 0x1 ref 1 00000100:00100000:3.0:1789762953.429490:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246647936 00000100:00100000:3.0:1789762953.429496:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246647936 00000100:00100000:2.0:1789762953.429533:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255902081893 time 255866775424 state 0x0 ref 1 00000100:00100000:2.0:1789762953.429546:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2354:x1876702246647552:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:3.0:1789762953.429609:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:3.0:1789762953.429622:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:2354:x1876702246647936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762953.429633:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762953.429648:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68000/0x5915dfb1c1b5b334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448be expref: 27 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.429658:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1789762953.429667:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:3.0:1789762953.429679:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762953.429698:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246648064 00000100:00100000:1.0:1789762953.429704:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246648064 00000100:00100000:3.0:1789762953.429714:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:2354:x1876702246647936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762953.429722:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:1.0:1789762953.429785:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:1.0:1789762953.429800:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:12946:x1876702246648064:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762953.429811:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.429827:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448e8 expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762953.429848:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 8388608, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x4000 00010000:00010000:1.0:1789762953.429872:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=255s v=(0 0) 00010000:00010000:1.0:1789762953.429877:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762953.429885:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 14 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.429896:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 14 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.429905:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec68a00, rc 0) 00000100:00100000:1.0:1789762953.429936:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:12946:x1876702246648064:12345-192.168.203.36@tcp:101:dd.0 Request processed in 142us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762953.429942:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:0.0:1789762953.429963:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.430006:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246646656 00000100:00100000:3.0:1789762953.430011:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246646656 00000100:00100000:1.0:1789762953.430070:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:1.0:1789762953.430078:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+26:12948:x1876702246646656:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762953.430088:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.430102:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b39d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448c5 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.430141:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b3a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.430149:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.430156:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762953.430162:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 16777216 00010000:00010000:1.0:1789762953.430208:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68800/0x5915dfb1c1b5b39d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448c5 expref: 29 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.430219:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448c5 expref: 28 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.430225:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:1.0:1789762953.430228:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762953.430230:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec69000, rc 0) 00000100:00100000:1.0:1789762953.430257:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12948:x1876702246646656:12345-192.168.203.36@tcp:101:dd.0 Request processed in 180us (298us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789762953.430262:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:1.0:1789762953.431743:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.431825:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246648448 00000100:00100000:3.0:1789762953.431830:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246648448 00000100:00100000:3.0:1789762953.431887:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:3.0:1789762953.431898:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0af8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12948:x1876702246648448:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:0.0:1789762953.431953:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.431999:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246648192 00000100:00100000:1.0:1789762953.432005:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246648192 00000100:00100000:1.0:1789762953.432044:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:1.0:1789762953.432052:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:2353:x1876702246648192:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762953.432076:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762953.432088:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec69000/0x5915dfb1c1b5b3a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448c5 expref: 30 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762953.432088:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0af8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12948:x1876702246648448:12345-192.168.203.36@tcp:35:dd.0 Request processed in 190us (344us total) trans 4294967461 rc 0/0 00010000:00010000:1.0:1789762953.432110:0:7992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:1.0:1789762953.432115:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762953.432116:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:1.0:1789762953.432144:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:2353:x1876702246648192:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 91us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762953.432155:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:1.0:1789762953.436327:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.436382:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246648576 00000100:00100000:2.0:1789762953.436391:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246648576 00000100:00100000:2.0:1789762953.436443:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:2.0:1789762953.436452:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:2356:x1876702246648576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762953.436470:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762953.436486:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5b349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448cc expref: 28 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.436519:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:2.0:1789762953.436523:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762953.436566:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:2356:x1876702246648576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762953.436573:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:1.0:1789762953.436897:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.436938:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246648704 00000100:00100000:1.0:1789762953.436943:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246648704 00000100:00100000:1.0:1789762953.436983:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:1.0:1789762953.436993:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:12948:x1876702246648704:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762953.437010:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.437032:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448ef expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.437060:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762953.437066:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762953.437078:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 16 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.437099:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 16 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.437131:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33fec69a00, rc 0) 00000100:00100000:1.0:1789762953.437169:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:12948:x1876702246648704:12345-192.168.203.36@tcp:101:dd.0 Request processed in 177us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762953.437177:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:1.0:1789762953.437247:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.437277:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246648960 00000100:00100000:3.0:1789762953.437284:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246648960 00000100:00100000:3.0:1789762953.437325:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:3.0:1789762953.437337:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+27:12952:x1876702246648960:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:0.0:1789762953.438148:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12952:x1876702246648960:12345-192.168.203.36@tcp:35:dd.0 Request processed in 809us (897us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789762953.438159:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:1.0:1789762953.440916:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.440954:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246649216 00000100:00100000:3.0:1789762953.440963:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246649216 00000100:00100000:2.0:1789762953.441032:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:2.0:1789762953.441042:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12945:x1876702246649216:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762953.441203:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:12945:x1876702246649216:12345-192.168.203.36@tcp:35:dd.0 Request processed in 162us (294us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789762953.441209:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:1.0:1789762953.444235:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.444322:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246649344 00000100:00100000:0.0:1789762953.444333:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246649344 00002000:00100000:0.0:1789762953.444373:0:12140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa:0x0] (4194304->8388607) req@ffff9b33ff441180 x1876702246649344/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762953.444399:0:12140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff441180 with x1876702246649344 ext(4194304->8388607) 00002000:00010000:0.0:1789762953.444405:0:12140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff441180 00000100:00100000:0.0:1789762953.444428:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255916775424 time 255866775424 state 0x1 ref 2 00000100:00100000:0.0:1789762953.444814:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2354:x1876702246647552:12345-192.168.203.36@tcp:4:dd.0 Request processed in 15269us (15446us total) trans 4294967639 rc 0/0 00000100:00100000:0.0:1789762953.444824:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 211 00002000:00100000:0.0:1789762953.444833:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4194303) req@ffff9b33ff440e00 x1876702246647552/t4294967639(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762953.444842:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff440e00 with x1876702246647552 ext(0->4194303) 00002000:00010000:0.0:1789762953.444847:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ff440e00 00000100:00100000:1.0:1789762953.446575:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.446599:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.446617:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246649472 00000100:00100000:3.0:1789762953.446625:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246649472 00000100:00100000:0.0:1789762953.446655:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246649728 00000100:00100000:0.0:1789762953.446663:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246649728 00000100:00100000:3.0:1789762953.446672:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:3.0:1789762953.446684:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:2355:x1876702246649472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762953.446695:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789762953.446719:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00010000:00010000:3.0:1789762953.446731:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23e00/0x5915dfb1c1b5b388 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e1 expref: 30 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.446738:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12947:x1876702246649728:12345-192.168.203.36@tcp:35:dd.0 00010000:00010000:3.0:1789762953.446785:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:3.0:1789762953.446789:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789762953.446822:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:2355:x1876702246649472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762953.446828:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:0.0:1789762953.446939:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:12947:x1876702246649728:12345-192.168.203.36@tcp:35:dd.0 Request processed in 209us (336us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1789762953.446949:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:1.0:1789762953.447310:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.447353:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246649856 00000100:00100000:2.0:1789762953.447359:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246649856 00000100:00100000:2.0:1789762953.447389:0:7992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:2.0:1789762953.447396:0:7992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:2353:x1876702246649856:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789762953.447403:0:7992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762953.447413:0:7992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767cc00/0x5915dfb1c1b5b373 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448da expref: 29 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.447423:0:7992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:2.0:1789762953.447425:0:7992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789762953.447455:0:7992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:2353:x1876702246649856:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762953.447471:0:7992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:3.0:1789762953.449014:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.449056:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246649984 00000100:00100000:0.0:1789762953.449068:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246649984 00002000:00100000:0.0:1789762953.449091:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xb:0x0] (0->1048575) req@ffff9b32c243ea00 x1876702246649984/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/0 e 0 to 0 dl 1789762964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762953.449099:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243ea00 with x1876702246649984 ext(0->1048575) 00002000:00010000:0.0:1789762953.449102:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c243ea00 00000100:00100000:0.0:1789762953.449117:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 229876363654 time 229876317233 state 0x0 ref 1 00000100:00100000:0.0:1789762953.449124:0:6915:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x2, head sequence 5: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 229876363654 time 229876317233 state 0x0 ref 1 00000100:00100000:0.0:1789762953.449137:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 3 deadline 255986380902 time 255886380902 state 0x1 ref 1 00000100:00100000:1.0:1789762953.452018:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.452055:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246650240 00000100:00100000:2.0:1789762953.452062:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246650240 00000100:00100000:2.0:1789762953.452097:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:2.0:1789762953.452107:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:12956:x1876702246650240:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762953.452209:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:12956:x1876702246650240:12345-192.168.203.36@tcp:35:dd.0 Request processed in 103us (194us total) trans 4294967465 rc 0/0 00000100:00100000:2.0:1789762953.452217:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:1.0:1789762953.452312:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.452361:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246650496 00000100:00100000:0.0:1789762953.452367:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246650496 00000100:00100000:0.0:1789762953.452394:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:0.0:1789762953.452401:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:12921:x1876702246650496:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:0.0:1789762953.452540:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12921:x1876702246650496:12345-192.168.203.36@tcp:35:dd.0 Request processed in 139us (228us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789762953.452546:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1789762953.479604:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255916775424 time 255916840718 state 0x0 ref 1 00000100:00100000:2.0:1789762953.479621:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2354:x1876702246649344:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:2.0:1789762953.491706:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2354:x1876702246649344:12345-192.168.203.36@tcp:4:dd.0 Request processed in 12081us (47468us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789762953.491716:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:2.0:1789762953.491727:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255916775424 time 255916840718 state 0x2 ref 0 00002000:00100000:2.0:1789762953.491741:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xa:0x0] (4194304->8388607) req@ffff9b33ff441180 x1876702246649344/t4294967335(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/448 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.491776:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ff441180 with x1876702246649344 ext(4194304->8388607) 00002000:00010000:2.0:1789762953.491784:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b33ff441180 00000100:00100000:2.0:1789762953.491820:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 255986380902 time 255929061450 state 0x0 ref 1 00000100:00100000:2.0:1789762953.491836:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c243ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2356:x1876702246649984:12345-192.168.203.36@tcp:3:dd.0 00000100:00100000:2.0:1789762953.495468:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c243ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2356:x1876702246649984:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3634us (46452us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762953.495478:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:2.0:1789762953.495487:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 255986380902 time 255929061450 state 0x2 ref 0 00002000:00100000:2.0:1789762953.495499:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xb:0x0] (0->1048575) req@ffff9b32c243ea00 x1876702246649984/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:734/0 lens 488/440 e 0 to 0 dl 1789762964 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762953.495523:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c243ea00 with x1876702246649984 ext(0->1048575) 00002000:00010000:2.0:1789762953.495528:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c243ea00 00000100:00100000:0.0:1789762953.545128:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.545181:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246650624 00000100:00100000:1.0:1789762953.545193:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246650624 00000100:00100000:1.0:1789762953.545245:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:1.0:1789762953.545254:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:12961:x1876702246650624:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:1.0:1789762953.545277:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.545293:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5b3b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448f6 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.545346:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5b3c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.545357:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5b3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.545378:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5b3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762953.545413:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00000004:00200000:1.0:1789762953.545415:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762953.545449:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5b3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.545470:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5b3b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448f6 expref: 32 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.545483:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5b3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448f6 expref: 31 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.545490:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:1.0:1789762953.545492:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762953.545494:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460c00, rc 0) 00000100:00100000:1.0:1789762953.545564:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:12961:x1876702246650624:12345-192.168.203.36@tcp:101:rm.0 Request processed in 311us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762953.545569:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:1.0:1789762953.547144:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.547221:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246650880 00000100:00100000:0.0:1789762953.547227:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246650880 00000100:00100000:0.0:1789762953.547259:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:0.0:1789762953.547265:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:12961:x1876702246650880:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1789762953.547273:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762953.547282:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789448fd expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.547328:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00010000:00010000:0.0:1789762953.547396:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b3c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448fd expref: 33 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.547425:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:0.0:1789762953.547427:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789762953.547431:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448fd expref: 33 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.547439:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767da00, rc 0) 00000100:00100000:0.0:1789762953.547477:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12961:x1876702246650880:12345-192.168.203.36@tcp:101:rm.0 Request processed in 210us (333us total) trans 4294967467 rc 301/301 00000100:00100000:0.0:1789762953.547485:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:0.0:1789762953.548854:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.548912:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246651008 00000100:00100000:2.0:1789762953.548919:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246651008 00000100:00100000:2.0:1789762953.548959:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:2.0:1789762953.548969:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12961:x1876702246651008:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:2.0:1789762953.550558:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12961:x1876702246651008:12345-192.168.203.36@tcp:37:rm.0 Request processed in 1591us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762953.550563:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:1.0:1789762953.551831:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.551862:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246651264 00000100:00100000:0.0:1789762953.551867:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246651264 00000100:00100000:0.0:1789762953.551895:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:0.0:1789762953.551901:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:12961:x1876702246651264:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:0.0:1789762953.552002:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12961:x1876702246651264:12345-192.168.203.36@tcp:35:rm.0 Request processed in 97us (169us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789762953.552012:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:0.0:1789762953.552795:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.552857:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246651520 00000100:00100000:1.0:1789762953.552863:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246651520 00000100:00100000:1.0:1789762953.552894:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:1.0:1789762953.552901:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12961:x1876702246651520:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:1.0:1789762953.552910:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.552924:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b3d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944904 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.552963:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5b3dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.552971:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5b3dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.552977:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5b3dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762953.552983:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00010000:00010000:1.0:1789762953.553020:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b3d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944904 expref: 36 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.553029:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5b3dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944904 expref: 35 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.553035:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:1.0:1789762953.553037:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789762953.553039:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460200, rc 0) 00000100:00100000:1.0:1789762953.553065:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246651520:12345-192.168.203.36@tcp:101:rm.0 Request processed in 166us (271us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789762953.553070:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:1.0:1789762953.553873:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.553906:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246651648 00000100:00100000:0.0:1789762953.553912:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246651648 00000100:00100000:0.0:1789762953.553939:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:0.0:1789762953.553946:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246651648:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:0.0:1789762953.553984:0:5925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7380074496 00000100:00100000:0.0:1789762953.554021:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246651648:12345-192.168.203.36@tcp:41:rm.0 Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762953.554033:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:2.0:1789762953.554809:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.554841:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246651904 00000100:00100000:0.0:1789762953.554846:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246651904 00000100:00100000:0.0:1789762953.554874:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:0.0:1789762953.554880:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246651904:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:0.0:1789762953.554960:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:12961:x1876702246651904:12345-192.168.203.36@tcp:35:rm.0 Request processed in 79us (152us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789762953.554965:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:2.0:1789762953.555789:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.555819:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246652160 00000100:00100000:0.0:1789762953.555823:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246652160 00000100:00100000:0.0:1789762953.555849:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 217 00000100:00100000:0.0:1789762953.555855:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:12961:x1876702246652160:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762953.555877:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762953.555889:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b35e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448d3 expref: 36 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555902:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b2e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944894 expref: 35 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555909:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:0.0:1789762953.555918:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460c00/0x5915dfb1c1b5b3c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448f6 expref: 34 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555924:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:0.0:1789762953.555926:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762953.555941:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555949:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555954:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555962:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555967:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.555972:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556021:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556027:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556031:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789762953.556189:0:7598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8896 00000004:00080000:0.0:1789762953.556197:0:7598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 255993444629ns, next at 256993442859ns, rc = 0 00000040:00080000:0.0:1789762953.556213:0:7598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 64 off8768 00000004:00080000:0.0:1789762953.556217:0:7598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 255993465294ns, next at 256993464677ns, rc = 0 00010000:00010000:0.0:1789762953.556241:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556256:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556262:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556267:0:7598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556272:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556276:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556290:0:7598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762953.556300:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556304:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556308:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556313:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.556316:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762953.556318:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556324:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556326:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556368:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762953.556369:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721d200) 00010000:00010000:0.0:1789762953.556372:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762953.556375:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556379:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556380:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b3f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556399:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556405:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556410:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9b33f721d200) 00010000:00010000:0.0:1789762953.556411:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556415:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789762953.556420:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556421:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556433:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c600/0x5915dfb1c1b5b3ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556434:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.556440:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556449:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.556451:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762953.556454:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762953.556456:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762953.556463:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:0.0:1789762953.556468:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.556472:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.556479:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b3ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762953.556514:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d93aa8cb reply state 00000000b9353815 transno 4294967471 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.556521:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762953.556554:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246652160:12345-192.168.203.36@tcp:36:rm.0 Request processed in 699us (767us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789762953.556559:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 217 00010000:00010000:3.0:1789762953.557180:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.557189:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.557194:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.557197:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762953.557200:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.557204:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.557213:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x3950208a (ffff9b33f721d300) 00010000:00010000:3.0:1789762953.557215:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762953.557217:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.557221:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5b3f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.558822:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.558908:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246652416 00000100:00100000:3.0:1789762953.558914:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246652416 00000100:00100000:3.0:1789762953.558948:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:3.0:1789762953.558955:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12961:x1876702246652416:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:3.0:1789762953.558978:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762953.558992:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22400/0x5915dfb1c1b5b311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448a9 expref: 34 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559015:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9b33ed2aa000) 00010000:00010000:3.0:1789762953.559022:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762953.559031:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559038:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559044:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559052:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559058:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559066:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559108:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559121:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559127:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789762953.559208:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].10, 64 off8832 00000040:00080000:3.0:1789762953.559218:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8960 00010000:00010000:3.0:1789762953.559239:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559246:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559251:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559255:0:5924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559259:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559273:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559286:0:5924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762953.559294:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559298:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559310:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559314:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762953.559316:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559320:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559326:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:3.0:1789762953.559338:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789762953.559341:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559346:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b414 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559354:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762953.559357:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559361:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559363:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559380:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82cc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762953.559381:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559386:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559388:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762953.559391:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559402:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559406:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559424:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9b33fec92d00) 00010000:00010000:2.0:1789762953.559428:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762953.559428:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:2.0:1789762953.559432:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559432:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762953.559437:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559441:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82cc00/0x5915dfb1c1b5b41b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.559452:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b406 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559464:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762953.559467:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1789762953.559468:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8075fda reply state 0000000093882186 transno 4294967472 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.559469:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762953.559490:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762953.559541:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246652416:12345-192.168.203.36@tcp:36:rm.0 Request processed in 586us (723us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789762953.559547:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 218 00010000:00010000:0.0:1789762953.560080:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.560089:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.560094:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.560098:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82ca00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.560100:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.560104:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.560111:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x25a23cf0 (ffff9b33fec92b00) 00010000:00010000:0.0:1789762953.560113:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.560115:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.560119:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82ca00/0x5915dfb1c1b5b40d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.569004:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.569045:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246652672 00000100:00100000:0.0:1789762953.569052:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246652672 00000100:00100000:0.0:1789762953.569087:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1789762953.569094:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12961:x1876702246652672:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:0.0:1789762953.569186:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246652672:12345-192.168.203.36@tcp:35:rm.0 Request processed in 92us (194us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789762953.569192:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:1.0:1789762953.570016:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.570095:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246652928 00000100:00100000:0.0:1789762953.570101:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246652928 00000100:00100000:0.0:1789762953.570131:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:0.0:1789762953.570137:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12961:x1876702246652928:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762953.570161:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762953.570173:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5b3dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944904 expref: 35 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570186:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b2c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894488d expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570193:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d400) 00010000:00010000:0.0:1789762953.570200:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33fec68400/0x5915dfb1c1b5b262 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944878 expref: 33 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570206:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535100) 00010000:00010000:0.0:1789762953.570210:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762953.570220:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570233:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570239:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570247:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570251:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570256:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570290:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570295:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570300:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.570387:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 4096 00010000:00010000:0.0:1789762953.570394:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570399:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570403:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570412:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.570415:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570420:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570425:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b33f721d600) 00010000:00010000:0.0:1789762953.570427:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762953.570429:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570433:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b430 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570444:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570448:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570451:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570455:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.570457:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570460:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570471:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:0.0:1789762953.570473:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.570475:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.570478:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b422 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762953.570484:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005924e17c reply state 0000000068d45ff3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.570489:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762953.570535:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12961:x1876702246652928:12345-192.168.203.36@tcp:36:rm.0 Request processed in 397us (519us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789762953.570539:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 219 00010000:00010000:3.0:1789762953.571161:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.571169:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.571174:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.571177:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762953.571180:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.571194:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.571201:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d000) 00010000:00010000:3.0:1789762953.571203:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762953.571205:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.571209:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b429 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.849185:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.849227:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246653056 00000100:00100000:2.0:1789762953.849237:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246653056 00000100:00100000:2.0:1789762953.849295:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 220 00000100:00100000:2.0:1789762953.849305:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:12972:x1876702246653056:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:2.0:1789762953.849325:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762953.849343:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894490b expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.849393:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22a00/0x5915dfb1c1b5b43e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.849405:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22a00/0x5915dfb1c1b5b43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.849413:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22a00/0x5915dfb1c1b5b43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762953.849462:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762953.849466:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762953.849480:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22a00/0x5915dfb1c1b5b43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.849517:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23200/0x5915dfb1c1b5b437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894490b expref: 35 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.849531:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22a00/0x5915dfb1c1b5b43e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894490b expref: 34 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.849538:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aa500) 00010000:00010000:2.0:1789762953.849540:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762953.849543:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ffd22a00, rc 0) 00000100:00100000:2.0:1789762953.849595:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12972:x1876702246653056:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 292us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762953.849602:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 220 00000100:00100000:2.0:1789762953.850780:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.850805:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246653312 00000100:00100000:0.0:1789762953.850811:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246653312 00000100:00100000:0.0:1789762953.850852:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 221 00000100:00100000:0.0:1789762953.850861:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12972:x1876702246653312:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:0.0:1789762953.850889:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762953.850910:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd22a00/0x5915dfb1c1b5b43e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894490b expref: 34 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.850931:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aa500) 00010000:00010000:0.0:1789762953.850942:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762953.850983:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851007:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851017:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851034:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851041:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851046:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.851436:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00010000:00010000:0.0:1789762953.851445:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851451:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851456:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851461:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.851464:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851469:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851487:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:0.0:1789762953.851489:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.851492:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.851496:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b445 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762953.851527:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078f293b4 reply state 000000008e2b0a59 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.851533:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762953.851574:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12972:x1876702246653312:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 716us (798us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789762953.851580:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 221 00010000:00010000:1.0:1789762953.852104:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.852115:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.852120:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.852124:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.852128:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.852140:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.852153:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d600) 00010000:00010000:1.0:1789762953.852156:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.852158:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.852163:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b44c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.856311:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.856393:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246653440 00000100:00100000:1.0:1789762953.856404:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246653440 00000100:00100000:1.0:1789762953.856456:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 222 00000100:00100000:1.0:1789762953.856465:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12973:x1876702246653440:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762953.856484:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.856513:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5b453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944912 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.856565:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b45a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.856575:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b45a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.856583:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b45a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762953.856613:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789762953.856622:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762953.856641:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b45a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.856663:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5b453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944912 expref: 36 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.856675:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b45a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944912 expref: 35 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.856681:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535a00) 00010000:00010000:1.0:1789762953.856683:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762953.856685:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460a00, rc 0) 00000100:00100000:1.0:1789762953.856745:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12973:x1876702246653440:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 282us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762953.856832:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 222 00000100:00100000:2.0:1789762953.857717:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.857790:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246653696 00000100:00100000:1.0:1789762953.857796:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246653696 00000100:00100000:1.0:1789762953.857834:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:1.0:1789762953.857844:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12973:x1876702246653696:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1789762953.857853:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.857855:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789762953.857869:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b45a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944912 expref: 35 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.857886:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535a00) 00010000:00010000:1.0:1789762953.857896:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762953.857906:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5b461 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944919 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.857996:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858004:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858012:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858025:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858030:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858035:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858072:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858077:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858083:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762953.858089:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00010000:00010000:1.0:1789762953.858097:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858102:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858121:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858127:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.858132:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858141:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858154:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f4535600) 00010000:00010000:1.0:1789762953.858158:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.858162:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858169:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858191:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858200:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858209:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858215:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.858218:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858237:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858248:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535d00) 00010000:00010000:1.0:1789762953.858251:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.858255:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858263:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858275:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858283:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858292:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858299:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.858302:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858310:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858319:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f4535300) 00010000:00010000:1.0:1789762953.858323:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.858327:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858345:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b46f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858384:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5b461 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944919 expref: 35 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858396:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f4535d00) 00010000:00010000:1.0:1789762953.858399:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.858404:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5b461 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944919 expref: 35 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.858421:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461800, rc 0) 00000100:00100000:1.0:1789762953.858467:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12973:x1876702246653696:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 624us (750us total) trans 0 rc 301/301 00000100:00100000:1.0:1789762953.858477:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:2.0:1789762953.859256:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762953.859298:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246653824 00000100:00100000:3.0:1789762953.859304:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246653824 00000100:00100000:3.0:1789762953.859344:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 224 00000100:00100000:3.0:1789762953.859353:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:12973:x1876702246653824:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762953.859363:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762953.859375:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b47d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944920 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.859409:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b484 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.859417:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.859424:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762953.859445:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762953.859454:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762953.859467:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.859484:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5b47d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944920 expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.859495:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944920 expref: 35 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762953.859517:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92c00) 00010000:00010000:3.0:1789762953.859521:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762953.859523:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82d000, rc 0) 00000100:00100000:3.0:1789762953.859559:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12973:x1876702246653824:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 207us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762953.859566:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 224 00000100:00100000:2.0:1789762953.860354:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.860390:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246654080 00000100:00100000:0.0:1789762953.860396:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246654080 00000100:00100000:0.0:1789762953.860428:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:0.0:1789762953.860436:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:12973:x1876702246654080:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1789762953.860443:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762953.860454:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b48b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944927 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860516:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860526:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860541:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860552:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860557:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860563:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.860609:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00010000:00010000:0.0:1789762953.860645:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860650:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860655:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860658:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.860661:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860666:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860673:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92c00) 00010000:00010000:0.0:1789762953.860675:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.860684:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860689:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860697:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860701:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860706:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860709:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.860711:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860715:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860719:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721da00) 00010000:00010000:0.0:1789762953.860721:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.860722:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860726:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5b499 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860746:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b48b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944927 expref: 37 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860840:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92c00) 00010000:00010000:0.0:1789762953.860842:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789762953.860846:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b48b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944927 expref: 37 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.860855:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767ce00, rc 0) 00000100:00100000:0.0:1789762953.860887:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:12973:x1876702246654080:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 451us (533us total) trans 4294967476 rc 301/301 00000100:00100000:0.0:1789762953.860895:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:0.0:1789762953.861558:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762953.861590:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246654336 00000100:00100000:2.0:1789762953.861595:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246654336 00000100:00100000:2.0:1789762953.861625:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 226 00000100:00100000:2.0:1789762953.861632:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:12973:x1876702246654336:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1789762953.861665:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.861679:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.861685:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762953.861790:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d43f0c2b reply state 00000000dc5587b2 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.861796:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762953.861800:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00000100:00100000:2.0:1789762953.861851:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:12973:x1876702246654336:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 220us (293us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789762953.861857:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 226 00010000:00010000:0.0:1789762953.862299:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.862305:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.862310:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.862314:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.862316:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.862322:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.862329:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:0.0:1789762953.862331:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789762953.862340:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.862344:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ffd23000/0x5915dfb1c1b5b4a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.862390:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.862421:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246654592 00000100:00100000:0.0:1789762953.862425:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246654592 00000100:00100000:0.0:1789762953.862454:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:0.0:1789762953.862461:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:12973:x1876702246654592:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1789762953.862571:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:12973:x1876702246654592:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 110us (181us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789762953.862576:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:2.0:1789762953.865863:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762953.865901:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246654720 00000100:00100000:1.0:1789762953.865908:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246654720 00000100:00100000:1.0:1789762953.865948:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:1.0:1789762953.865961:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:12974:x1876702246654720:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1789762953.865989:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.866005:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5b4ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894492e expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866045:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866055:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866071:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866081:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866087:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866093:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866124:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b4c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866130:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866134:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762953.866152:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00000004:00200000:1.0:1789762953.866155:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762953.866167:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866175:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866179:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866195:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866199:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.866202:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866207:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866215:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92c00) 00010000:00010000:1.0:1789762953.866218:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.866220:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866225:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866234:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866238:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866241:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866245:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.866246:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866268:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866279:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f4535d00) 00010000:00010000:1.0:1789762953.866281:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.866283:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866287:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866308:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5b4ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894492e expref: 40 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866316:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894492e expref: 39 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.866321:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f4535300) 00010000:00010000:1.0:1789762953.866322:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762953.866324:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460600, rc 0) 00000100:00100000:1.0:1789762953.866362:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+39:12974:x1876702246654720:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 406us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762953.866370:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:1.0:1789762953.867315:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.867357:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246654976 00000100:00100000:0.0:1789762953.867364:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246654976 00000100:00100000:0.0:1789762953.867396:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 228 00000100:00100000:0.0:1789762953.867401:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+39:12974:x1876702246654976:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:0.0:1789762953.867421:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762953.867435:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5b4c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894492e expref: 39 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.867445:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f4535300) 00010000:00010000:0.0:1789762953.867452:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762953.867464:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.867471:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.867485:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762953.867569:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f05de6d reply state 000000003f7bba1e transno 4294967479 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.867575:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789762953.867579:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00000100:00100000:0.0:1789762953.867623:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:12974:x1876702246654976:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 222us (310us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789762953.867629:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 228 00010000:00010000:1.0:1789762953.868095:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.868105:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.868117:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.868121:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767ce00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.868124:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.868128:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.868138:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721da00) 00010000:00010000:1.0:1789762953.868141:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789762953.868143:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.868149:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5b4ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762953.884247:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.884290:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246655104 00000100:00100000:0.0:1789762953.884301:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246655104 00000100:00100000:0.0:1789762953.884355:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:0.0:1789762953.884364:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+39:12980:x1876702246655104:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762953.884382:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762953.884395:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b4d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944935 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884444:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884459:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884470:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884481:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884492:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884496:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884567:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b4e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884573:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884578:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762953.884599:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00000004:00200000:0.0:1789762953.884602:0:7598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762953.884613:0:7598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884620:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884625:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884630:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884633:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.884636:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884648:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884656:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92c00) 00010000:00010000:0.0:1789762953.884658:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.884661:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884666:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5b4d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884673:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884677:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884681:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884685:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762953.884686:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884690:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884694:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d400) 00010000:00010000:0.0:1789762953.884696:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762953.884697:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884709:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5b4df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884730:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5b4d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944935 expref: 41 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884738:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944935 expref: 40 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.884743:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721dd00) 00010000:00010000:0.0:1789762953.884745:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762953.884747:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767c400, rc 0) 00000100:00100000:0.0:1789762953.884815:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:12980:x1876702246655104:12345-192.168.203.36@tcp:101:dd.0 Request processed in 452us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762953.884822:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:2.0:1789762953.885681:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.885728:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246655360 00000100:00100000:0.0:1789762953.885734:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246655360 00000100:00100000:1.0:1789762953.885848:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 230 00000100:00100000:1.0:1789762953.885872:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:12980:x1876702246655360:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762953.885890:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762953.885910:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894493c expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.885985:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.885995:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886010:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886145:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886157:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886165:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762953.886424:0:12191:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd:0x0], index 0: 0 00010000:00010000:1.0:1789762953.886567:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5b502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886575:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5b502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886582:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5b502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886613:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886621:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886629:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886636:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762953.886647:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886653:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886663:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721dd00) 00010000:00010000:1.0:1789762953.886665:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762953.886668:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886673:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5b4f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762953.886685:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d813b1d0 reply state 00000000770ddd8a transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762953.886690:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762953.886714:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461600/0x5915dfb1c1b5b4ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894493c expref: 43 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886728:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5b502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894493c expref: 42 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762953.886734:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b33f4535600) 00010000:00010000:1.0:1789762953.886736:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762953.886738:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460400, rc 0) 00000100:00100000:1.0:1789762953.886803:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+43:12980:x1876702246655360:12345-192.168.203.36@tcp:101:dd.0 Request processed in 943us (1122us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789762953.886811:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 230 00010000:00010000:2.0:1789762953.887339:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.887347:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.887352:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.887357:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762953.887360:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.887375:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.887386:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4009f790 (ffff9b33f4535d00) 00010000:00010000:2.0:1789762953.887389:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762953.887392:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762953.887396:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5b4fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762953.889728:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.889792:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246655488 00000100:00100000:0.0:1789762953.889799:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246655488 00000100:00100000:0.0:1789762953.889836:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255916775424 time 255916840718 state 0x0 ref 1 00000100:00100000:0.0:1789762953.889847:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 255966840718 time 255916840718 state 0x1 ref 1 00000100:00100000:0.0:1789762953.889870:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255966840718 time 256327115008 state 0x0 ref 1 00000100:00100000:0.0:1789762953.889880:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+16:2354:x1876702246655488:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762953.889923:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789762953.889928:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.889938:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1789762953.889942:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.889946:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.889955:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762953.894185:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967640 is committed 00002000:00010000:0.0:1789762953.894255:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789762953.894259:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1789762954 00002000:00010000:0.0:1789762953.894261:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1789762954 00002000:00010000:0.0:1789762953.894263:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1789762953.894271:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.894278:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.894284:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.894288:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762953.894292:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.894303:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.894313:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.894318:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b510 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.894359:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246655488:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4480us (4631us total) trans 4294967640 rc 0/0 00000100:00100000:0.0:1789762953.894366:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:0.0:1789762953.894372:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255966840718 time 256327115008 state 0x2 ref 0 00000100:00100000:2.0:1789762953.906333:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.906374:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246655616 00000100:00100000:0.0:1789762953.906381:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246655616 00000100:00100000:0.0:1789762953.906411:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 255966840718 time 256327115008 state 0x0 ref 1 00000100:00100000:0.0:1789762953.906421:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 2 deadline 256377115008 time 256327115008 state 0x1 ref 1 00000100:00100000:0.0:1789762953.906444:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 256377115008 time 256343688889 state 0x0 ref 1 00000100:00100000:0.0:1789762953.906460:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246655616:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762953.906481:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 1048576, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x800 00010000:00010000:0.0:1789762953.906492:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.906518:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1789762953.906522:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.906525:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.906535:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762953.911188:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967641 is committed 00002000:00010000:0.0:1789762953.911291:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1789762953.911296:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:0.0:1789762953.911303:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911311:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911317:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911321:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762953.911324:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911330:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911346:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.911352:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b517 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.911396:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246655616:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4943us (5064us total) trans 4294967641 rc 0/0 00000100:00100000:0.0:1789762953.911402:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:0.0:1789762953.911409:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 256377115008 time 256343688889 state 0x2 ref 0 00000100:00100000:1.0:1789762953.913322:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.913393:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246655744 00000100:00100000:0.0:1789762953.913398:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246655744 00000100:00100000:0.0:1789762953.913423:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 256377115008 time 256343688889 state 0x0 ref 1 00000100:00100000:0.0:1789762953.913432:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 1 deadline 256393688889 time 256343688889 state 0x1 ref 1 00000100:00100000:0.0:1789762953.913454:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256393688889 time 256350699494 state 0x0 ref 1 00000100:00100000:0.0:1789762953.913463:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246655744:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762953.913480:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 2097152, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x1000 00010000:00010000:0.0:1789762953.913486:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.913516:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1789762953.913519:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.913522:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.913530:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762953.917920:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967642 is committed 00002000:00010000:0.0:1789762953.917979:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789762953.917984:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:0.0:1789762953.917990:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.917999:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.918005:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.918009:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762953.918011:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.918017:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.918037:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.918042:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b51e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.918082:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246655744:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4620us (4760us total) trans 4294967642 rc 0/0 00000100:00100000:0.0:1789762953.918088:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:0.0:1789762953.918094:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256393688889 time 256350699494 state 0x2 ref 0 00000100:00100000:2.0:1789762953.920030:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.920102:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246655872 00000100:00100000:0.0:1789762953.920108:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246655872 00000100:00100000:0.0:1789762953.920133:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256393688889 time 256350699494 state 0x0 ref 1 00000100:00100000:0.0:1789762953.920141:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256400699494 time 256350699494 state 0x1 ref 1 00000100:00100000:0.0:1789762953.963541:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256400699494 time 256400769485 state 0x0 ref 1 00000100:00100000:0.0:1789762953.963565:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246655872:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762953.963609:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 3145728, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x1800 00010000:00010000:0.0:1789762953.963617:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.963640:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1789762953.963644:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762953.963649:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.963660:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762953.968568:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967643 is committed 00002000:00010000:0.0:1789762953.968642:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1789762953.968646:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:0.0:1789762953.968655:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.968663:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.968670:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.968675:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762953.968678:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.968685:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.968708:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762953.968714:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b525 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762953.968782:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246655872:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5224us (48754us total) trans 4294967643 rc 0/0 00000100:00100000:0.0:1789762953.968789:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 217 00000100:00100000:0.0:1789762953.968796:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256400699494 time 256400769485 state 0x2 ref 0 00000100:00100000:2.0:1789762953.970925:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762953.970959:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656000 00000100:00100000:0.0:1789762953.970968:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656000 00000100:00100000:0.0:1789762953.971001:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256400699494 time 256400769485 state 0x0 ref 1 00000100:00100000:0.0:1789762953.971012:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256450769485 time 256400769485 state 0x1 ref 1 00000100:00100000:2.0:1789762954.013598:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256450769485 time 256450834992 state 0x0 ref 1 00000100:00100000:2.0:1789762954.013616:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656000:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.013648:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 4194304, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x2000 00010000:00010000:2.0:1789762954.013654:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.013664:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.013668:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.013672:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.013694:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.018376:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967644 is committed 00002000:00010000:0.0:1789762954.018438:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1789762954.018443:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:0.0:1789762954.018451:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.018460:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.018476:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.018481:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.018484:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.018490:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.018516:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.018523:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b52c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.018568:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656000:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4957us (47644us total) trans 4294967644 rc 0/0 00000100:00100000:0.0:1789762954.018574:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:0.0:1789762954.018581:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256450769485 time 256450834992 state 0x2 ref 0 00000100:00100000:1.0:1789762954.020708:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.020747:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656128 00000100:00100000:0.0:1789762954.020769:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656128 00000100:00100000:0.0:1789762954.020798:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256450769485 time 256450834992 state 0x0 ref 1 00000100:00100000:0.0:1789762954.020817:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256500834992 time 256450834992 state 0x1 ref 1 00000100:00100000:2.0:1789762954.063681:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256500834992 time 256500911742 state 0x0 ref 1 00000100:00100000:2.0:1789762954.063701:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246656128:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.063744:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 5242880, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x2800 00010000:00010000:2.0:1789762954.063768:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.063782:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.063786:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.063798:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.063809:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.068537:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967645 is committed 00002000:00010000:0.0:1789762954.068609:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789762954.068615:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:0.0:1789762954.068624:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.068632:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.068638:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.068643:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.068647:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.068653:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.068665:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.068671:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a7c77b/0x5915dfb1c1b5b533 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.068734:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246656128:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5039us (48027us total) trans 4294967645 rc 0/0 00000100:00100000:0.0:1789762954.068742:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:0.0:1789762954.068777:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256500834992 time 256500911742 state 0x2 ref 0 00000100:00100000:1.0:1789762954.070866:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.070900:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656256 00000100:00100000:0.0:1789762954.070908:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656256 00000100:00100000:0.0:1789762954.070942:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256500834992 time 256500911742 state 0x0 ref 1 00000100:00100000:0.0:1789762954.070952:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256550911742 time 256500911742 state 0x1 ref 1 00010000:00010000:0.0:1789762954.106879:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762954.113738:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256550911742 time 256550974704 state 0x0 ref 1 00000100:00100000:2.0:1789762954.113775:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656256:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.113822:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 6291456, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3000 00010000:00010000:2.0:1789762954.113829:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.113852:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.113856:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.113860:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.113871:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.118662:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967646 is committed 00002000:00010000:2.0:1789762954.118730:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1789762954.118734:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:2.0:1789762954.118743:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.118765:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.118772:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.118777:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762954.118780:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.118787:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.118809:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.118815:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b53a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762954.118864:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656256:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5112us (47998us total) trans 4294967646 rc 0/0 00000100:00100000:2.0:1789762954.118873:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 220 00000100:00100000:2.0:1789762954.118883:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256550911742 time 256550974704 state 0x2 ref 0 00000100:00100000:0.0:1789762954.121088:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762954.121127:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656384 00000100:00100000:2.0:1789762954.121136:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656384 00000100:00100000:2.0:1789762954.121170:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256550911742 time 256550974704 state 0x0 ref 1 00000100:00100000:2.0:1789762954.121181:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256600974704 time 256550974704 state 0x1 ref 1 00000100:00100000:2.0:1789762954.163793:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256600974704 time 256601026477 state 0x0 ref 1 00000100:00100000:2.0:1789762954.163814:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246656384:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.163861:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 7340032, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x3800 00010000:00010000:2.0:1789762954.163868:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.163897:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.163901:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.163906:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.163917:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.168877:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967647 is committed 00002000:00010000:0.0:1789762954.168935:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:0.0:1789762954.168940:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:0.0:1789762954.168949:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.168957:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.168964:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.168969:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.168978:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.168985:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.168999:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.169004:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b541 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.169052:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246656384:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5244us (47965us total) trans 4294967647 rc 0/0 00000100:00100000:0.0:1789762954.169060:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 221 00000100:00100000:0.0:1789762954.169068:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256600974704 time 256601026477 state 0x2 ref 0 00000100:00100000:1.0:1789762954.171165:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.171230:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656512 00000100:00100000:0.0:1789762954.171238:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656512 00000100:00100000:0.0:1789762954.171273:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256600974704 time 256601026477 state 0x0 ref 1 00000100:00100000:0.0:1789762954.171283:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256651026477 time 256601026477 state 0x1 ref 1 00000100:00100000:2.0:1789762954.213889:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256651026477 time 256651122157 state 0x0 ref 1 00000100:00100000:2.0:1789762954.213909:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656512:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.213956:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 8388608, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x4000 00010000:00010000:2.0:1789762954.213964:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.213977:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.213980:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.213985:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.213995:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.218523:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967648 is committed 00002000:00010000:0.0:1789762954.218590:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:0.0:1789762954.218596:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:0.0:1789762954.218604:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.218622:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.218628:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.218633:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.218636:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.218644:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.218657:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.218662:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b548 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.218710:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656512:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4807us (47546us total) trans 4294967648 rc 0/0 00000100:00100000:0.0:1789762954.218717:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 222 00000100:00100000:0.0:1789762954.218725:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256651026477 time 256651122157 state 0x2 ref 0 00000100:00100000:1.0:1789762954.220927:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762954.221003:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656640 00000100:00100000:2.0:1789762954.221011:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656640 00000100:00100000:2.0:1789762954.221053:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256651026477 time 256651122157 state 0x0 ref 1 00000100:00100000:2.0:1789762954.221063:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256701122157 time 256651122157 state 0x1 ref 1 00000100:00100000:0.0:1789762954.263952:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256701122157 time 256701185002 state 0x0 ref 1 00000100:00100000:0.0:1789762954.263980:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246656640:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762954.264020:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 9437184, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x4800 00010000:00010000:0.0:1789762954.264027:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.264039:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1789762954.264042:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.264047:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.264059:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.269024:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967649 is committed 00002000:00010000:0.0:1789762954.269133:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:0.0:1789762954.269138:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 18432 -> 20480 00010000:00010000:0.0:1789762954.269147:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.269155:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.269162:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.269167:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.269177:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.269184:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.269196:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.269201:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b54f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.269254:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246656640:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5278us (48327us total) trans 4294967649 rc 0/0 00000100:00100000:0.0:1789762954.269261:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:0.0:1789762954.269268:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256701122157 time 256701185002 state 0x2 ref 0 00000100:00100000:2.0:1789762954.271165:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.271202:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656768 00000100:00100000:0.0:1789762954.271210:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656768 00000100:00100000:0.0:1789762954.271244:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256701122157 time 256701185002 state 0x0 ref 1 00000100:00100000:0.0:1789762954.271254:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256751185002 time 256701185002 state 0x1 ref 1 00000100:00100000:3.0:1789762954.314021:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256751185002 time 256751258541 state 0x0 ref 1 00000100:00100000:3.0:1789762954.314038:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f74a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656768:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762954.314068:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 10485760, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x5000 00010000:00010000:3.0:1789762954.314074:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.314085:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:3.0:1789762954.314089:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762954.314093:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.314115:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.318918:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967650 is committed 00002000:00010000:3.0:1789762954.319003:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:3.0:1789762954.319010:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 20480 -> 22528 00010000:00010000:3.0:1789762954.319019:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.319028:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.319034:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.319039:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762954.319042:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.319049:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.319060:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.319064:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b556 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.319118:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f74a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656768:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5084us (47956us total) trans 4294967650 rc 0/0 00000100:00100000:3.0:1789762954.319125:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 224 00000100:00100000:3.0:1789762954.319131:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256751185002 time 256751258541 state 0x2 ref 0 00000100:00100000:2.0:1789762954.321033:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.321116:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246656896 00000100:00100000:0.0:1789762954.321125:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246656896 00000100:00100000:0.0:1789762954.321157:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256751185002 time 256751258541 state 0x0 ref 1 00000100:00100000:0.0:1789762954.321176:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256801258541 time 256751258541 state 0x1 ref 1 00000100:00100000:0.0:1789762954.364080:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256801258541 time 256801312357 state 0x0 ref 1 00000100:00100000:0.0:1789762954.364100:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656896:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762954.364141:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 11534336, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x5800 00010000:00010000:0.0:1789762954.364149:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.364161:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1789762954.364165:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.364169:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.364180:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.368733:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967651 is committed 00002000:00010000:0.0:1789762954.368811:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1789762954.368816:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 22528 -> 24576 00010000:00010000:0.0:1789762954.368824:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.368832:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.368849:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.368854:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.368858:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.368864:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.368877:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.368883:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096946335/0x5915dfb1c1b5b55d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.368935:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246656896:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4841us (47901us total) trans 4294967651 rc 0/0 00000100:00100000:0.0:1789762954.368941:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:0.0:1789762954.368948:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256801258541 time 256801312357 state 0x2 ref 0 00000100:00100000:1.0:1789762954.371295:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.371330:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657024 00000100:00100000:0.0:1789762954.371338:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657024 00000100:00100000:0.0:1789762954.371369:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256801258541 time 256801312357 state 0x0 ref 1 00000100:00100000:0.0:1789762954.371387:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256851312357 time 256801312357 state 0x1 ref 1 00000100:00100000:2.0:1789762954.414230:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256851312357 time 256851452556 state 0x0 ref 1 00000100:00100000:2.0:1789762954.414263:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657024:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.414331:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 12582912, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x6000 00010000:00010000:2.0:1789762954.414344:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.414366:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.414373:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.414381:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.414399:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.422649:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967652 is committed 00002000:00010000:0.0:1789762954.422794:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1789762954.422799:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:0.0:1789762954.422808:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.422816:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.422823:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.422828:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.422831:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.422856:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.422879:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.422890:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b564 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.423011:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657024:12345-192.168.203.36@tcp:4:dd.0 Request processed in 8759us (51715us total) trans 4294967652 rc 0/0 00000100:00100000:0.0:1789762954.423018:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 226 00000100:00100000:0.0:1789762954.423026:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256851312357 time 256851452556 state 0x2 ref 0 00000100:00100000:2.0:1789762954.426321:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762954.426362:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657152 00000100:00100000:3.0:1789762954.426370:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657152 00000100:00100000:3.0:1789762954.426406:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256851312357 time 256851452556 state 0x0 ref 1 00000100:00100000:3.0:1789762954.426417:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256901452556 time 256851452556 state 0x1 ref 1 00000100:00100000:2.0:1789762954.464323:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256901452556 time 256901550625 state 0x0 ref 1 00000100:00100000:2.0:1789762954.464350:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657152:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.464417:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 13631488, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x6800 00010000:00010000:2.0:1789762954.464426:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.464454:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.464458:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.464465:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.464481:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.470898:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967653 is committed 00002000:00010000:0.0:1789762954.470977:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789762954.470982:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 26624 -> 28672 00010000:00010000:0.0:1789762954.470994:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.471004:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.471011:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.471017:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.471021:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.471028:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.471043:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.471058:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b56b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.471125:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657152:12345-192.168.203.36@tcp:4:dd.0 Request processed in 6782us (44801us total) trans 4294967653 rc 0/0 00000100:00100000:0.0:1789762954.471133:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:0.0:1789762954.471142:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256901452556 time 256901550625 state 0x2 ref 0 00000100:00100000:1.0:1789762954.473665:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.473703:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657280 00000100:00100000:0.0:1789762954.473710:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657280 00000100:00100000:0.0:1789762954.473779:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256901452556 time 256901550625 state 0x0 ref 1 00000100:00100000:0.0:1789762954.473796:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256951550625 time 256901550625 state 0x1 ref 1 00000100:00100000:2.0:1789762954.514404:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256951550625 time 256951636989 state 0x0 ref 1 00000100:00100000:2.0:1789762954.514427:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657280:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.514471:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 14680064, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x7000 00010000:00010000:2.0:1789762954.514478:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.514492:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=256s v=(0 0) 00010000:00010000:2.0:1789762954.514510:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.514517:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.514543:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.519647:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967654 is committed 00002000:00010000:0.0:1789762954.519714:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:0.0:1789762954.519719:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 28672 -> 30720 00010000:00010000:0.0:1789762954.519727:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.519735:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.519742:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.519772:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.519776:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.519783:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.519795:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.519801:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b572 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.519849:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657280:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5429us (46187us total) trans 4294967654 rc 0/0 00000100:00100000:0.0:1789762954.519856:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 228 00000100:00100000:0.0:1789762954.519863:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256951550625 time 256951636989 state 0x2 ref 0 00000100:00100000:1.0:1789762954.521941:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.521975:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657408 00000100:00100000:0.0:1789762954.521982:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657408 00000100:00100000:0.0:1789762954.522010:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 256951550625 time 256951636989 state 0x0 ref 1 00000100:00100000:0.0:1789762954.522020:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257001636989 time 256951636989 state 0x1 ref 1 00000100:00100000:0.0:1789762954.564458:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257001636989 time 257001692805 state 0x0 ref 1 00000100:00100000:0.0:1789762954.564487:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657408:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762954.564554:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 15728640, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x7800 00010000:00010000:0.0:1789762954.564562:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.564576:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:0.0:1789762954.564579:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.564584:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.564596:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.570202:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967655 is committed 00002000:00010000:0.0:1789762954.570303:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:0.0:1789762954.570308:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 30720 -> 32768 00010000:00010000:0.0:1789762954.570316:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.570325:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.570331:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.570336:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.570346:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.570353:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.570366:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.570371:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5b579 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.570434:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657408:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5952us (48494us total) trans 4294967655 rc 0/0 00000100:00100000:0.0:1789762954.570441:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:0.0:1789762954.570448:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257001636989 time 257001692805 state 0x2 ref 0 00000100:00100000:2.0:1789762954.572796:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.572844:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657536 00000100:00100000:0.0:1789762954.572852:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657536 00000100:00100000:0.0:1789762954.572883:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257001636989 time 257001692805 state 0x0 ref 1 00000100:00100000:0.0:1789762954.572894:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257051692805 time 257001692805 state 0x1 ref 1 00000100:00100000:3.0:1789762954.614549:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257051692805 time 257051785658 state 0x0 ref 1 00000100:00100000:3.0:1789762954.614566:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657536:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762954.614597:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 16777216, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x8000 00010000:00010000:3.0:1789762954.614603:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.614614:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1789762954.614617:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762954.614621:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.614630:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.619794:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967656 is committed 00002000:00010000:3.0:1789762954.619862:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:3.0:1789762954.619867:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 32768 -> 34816 00010000:00010000:3.0:1789762954.619874:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.619882:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.619888:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.619892:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762954.619896:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.619903:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.619914:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.619919:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b580 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.619975:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657536:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5414us (47182us total) trans 4294967656 rc 0/0 00000100:00100000:3.0:1789762954.619987:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 230 00000100:00100000:3.0:1789762954.619994:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257051692805 time 257051785658 state 0x2 ref 0 00000100:00100000:1.0:1789762954.622115:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.622157:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657664 00000100:00100000:0.0:1789762954.622165:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657664 00000100:00100000:0.0:1789762954.622214:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257051692805 time 257051785658 state 0x0 ref 1 00000100:00100000:0.0:1789762954.622233:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257101785658 time 257051785658 state 0x1 ref 1 00000100:00100000:3.0:1789762954.664623:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257101785658 time 257101855610 state 0x0 ref 1 00000100:00100000:3.0:1789762954.664643:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657664:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762954.664699:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 17825792, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x8800 00010000:00010000:3.0:1789762954.664706:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.664719:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1789762954.664723:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762954.664727:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.664738:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.670163:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967657 is committed 00002000:00010000:3.0:1789762954.670234:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:3.0:1789762954.670240:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 34816 -> 36864 00010000:00010000:3.0:1789762954.670251:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.670262:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.670280:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.670285:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762954.670289:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.670299:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.670329:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.670339:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b587 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.670395:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657664:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5758us (48281us total) trans 4294967657 rc 0/0 00000100:00100000:3.0:1789762954.670402:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:3.0:1789762954.670419:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257101785658 time 257101855610 state 0x2 ref 0 00000100:00100000:1.0:1789762954.672741:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.672790:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657792 00000100:00100000:0.0:1789762954.672799:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657792 00000100:00100000:0.0:1789762954.672833:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257101785658 time 257101855610 state 0x0 ref 1 00000100:00100000:0.0:1789762954.672843:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257151855610 time 257101855610 state 0x1 ref 1 00000100:00100000:2.0:1789762954.714703:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257151855610 time 257151931941 state 0x0 ref 1 00000100:00100000:2.0:1789762954.714722:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657792:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.714785:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 18874368, mtime: 0x6aad9d8a, atime: 0x0, ctime: 0x6aad9d8a, blocks: 0x9000 00010000:00010000:2.0:1789762954.714793:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.714807:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1789762954.714812:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.714818:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.714832:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.719642:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967658 is committed 00002000:00010000:0.0:1789762954.719714:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:0.0:1789762954.719719:0:12139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 1789762954 -> 1789762955 00002000:00010000:0.0:1789762954.719721:0:12139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 1789762954 -> 1789762955 00002000:00010000:0.0:1789762954.719723:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 36864 -> 38912 00010000:00010000:0.0:1789762954.719730:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.719738:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.719745:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.719766:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.719770:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.719787:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.719799:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.719805:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b58e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.719854:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246657792:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5138us (47113us total) trans 4294967658 rc 0/0 00000100:00100000:0.0:1789762954.719860:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:0.0:1789762954.719867:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257151855610 time 257151931941 state 0x2 ref 0 00000100:00100000:2.0:1789762954.721834:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762954.721873:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246657920 00000100:00100000:3.0:1789762954.721881:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246657920 00000100:00100000:3.0:1789762954.721914:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257151855610 time 257151931941 state 0x0 ref 1 00000100:00100000:3.0:1789762954.721935:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257201931941 time 257151931941 state 0x1 ref 1 00000100:00100000:2.0:1789762954.764779:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257201931941 time 257202011769 state 0x0 ref 1 00000100:00100000:2.0:1789762954.764798:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657920:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.764842:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 19922944, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x9800 00010000:00010000:2.0:1789762954.764849:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.764875:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1789762954.764878:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.764883:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.764895:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.769917:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967659 is committed 00002000:00010000:2.0:1789762954.770019:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:2.0:1789762954.770024:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 38912 -> 40960 00010000:00010000:2.0:1789762954.770036:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.770046:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.770052:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.770057:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762954.770061:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.770068:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.770092:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.770098:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b595 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762954.770163:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246657920:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5367us (48326us total) trans 4294967659 rc 0/0 00000100:00100000:2.0:1789762954.770171:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:2.0:1789762954.770181:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257201931941 time 257202011769 state 0x2 ref 0 00000100:00100000:1.0:1789762954.772569:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762954.772605:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658048 00000100:00100000:3.0:1789762954.772614:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658048 00000100:00100000:3.0:1789762954.772654:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257201931941 time 257202011769 state 0x0 ref 1 00000100:00100000:3.0:1789762954.772666:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257252011769 time 257202011769 state 0x1 ref 1 00000100:00100000:2.0:1789762954.814864:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257252011769 time 257252093646 state 0x0 ref 1 00000100:00100000:2.0:1789762954.814886:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246658048:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762954.814934:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 20971520, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xa000 00010000:00010000:2.0:1789762954.814944:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.814958:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1789762954.814963:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762954.814970:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.814991:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.819865:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967660 is committed 00002000:00010000:2.0:1789762954.819944:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:2.0:1789762954.819951:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 40960 -> 43008 00010000:00010000:2.0:1789762954.819961:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.819974:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.819984:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.819990:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762954.819993:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.819999:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.820012:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762954.820017:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b59c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762954.820069:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246658048:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5190us (47501us total) trans 4294967660 rc 0/0 00000100:00100000:2.0:1789762954.820082:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:2.0:1789762954.820090:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257252011769 time 257252093646 state 0x2 ref 0 00000100:00100000:0.0:1789762954.822261:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762954.822297:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658176 00000100:00100000:2.0:1789762954.822305:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658176 00000100:00100000:2.0:1789762954.822338:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257252011769 time 257252093646 state 0x0 ref 1 00000100:00100000:2.0:1789762954.822350:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257302093646 time 257252093646 state 0x1 ref 1 00000100:00100000:0.0:1789762954.864965:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257302093646 time 257302192594 state 0x0 ref 1 00000100:00100000:0.0:1789762954.864992:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246658176:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762954.865054:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 22020096, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xa800 00010000:00010000:0.0:1789762954.865064:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.865081:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:0.0:1789762954.865086:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.865108:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.865123:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.870121:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967661 is committed 00002000:00010000:0.0:1789762954.870221:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789762954.870226:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 43008 -> 45056 00010000:00010000:0.0:1789762954.870235:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.870244:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.870251:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.870256:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767de00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762954.870259:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.870265:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.870279:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.870293:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762954.870364:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246658176:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5379us (48112us total) trans 4294967661 rc 0/0 00000100:00100000:0.0:1789762954.870374:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:0.0:1789762954.870385:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257302093646 time 257302192594 state 0x2 ref 0 00000100:00100000:1.0:1789762954.872718:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762954.872809:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658304 00000100:00100000:2.0:1789762954.872819:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658304 00000100:00100000:2.0:1789762954.872869:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257302093646 time 257302192594 state 0x0 ref 1 00000100:00100000:2.0:1789762954.872881:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257352192594 time 257302192594 state 0x1 ref 1 00000100:00100000:0.0:1789762954.915065:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257352192594 time 257352298700 state 0x0 ref 1 00000100:00100000:0.0:1789762954.915086:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246658304:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762954.915146:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 23068672, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xb000 00010000:00010000:0.0:1789762954.915157:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.915174:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:0.0:1789762954.915180:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762954.915184:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762954.915196:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762954.920029:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967662 is committed 00002000:00010000:1.0:1789762954.920113:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:1.0:1789762954.920118:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 45056 -> 47104 00010000:00010000:1.0:1789762954.920127:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.920135:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.920141:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.920146:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767de00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762954.920150:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.920157:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.920170:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762954.920174:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b5aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762954.920241:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246658304:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5161us (47525us total) trans 4294967662 rc 0/0 00000100:00100000:1.0:1789762954.920248:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 236 00000100:00100000:1.0:1789762954.920256:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257352192594 time 257352298700 state 0x2 ref 0 00000100:00100000:2.0:1789762954.922460:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762954.922547:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658432 00000100:00100000:0.0:1789762954.922560:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658432 00000100:00100000:0.0:1789762954.922594:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257352192594 time 257352298700 state 0x0 ref 1 00000100:00100000:0.0:1789762954.922605:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257402298700 time 257352298700 state 0x1 ref 1 00000100:00100000:3.0:1789762954.965145:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257402298700 time 257402371734 state 0x0 ref 1 00000100:00100000:3.0:1789762954.965166:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246658432:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762954.965211:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 24117248, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xb800 00010000:00010000:3.0:1789762954.965218:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.965232:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1789762954.965236:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762954.965240:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.965251:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762954.970221:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967663 is committed 00002000:00010000:3.0:1789762954.970283:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:3.0:1789762954.970295:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 47104 -> 49152 00010000:00010000:3.0:1789762954.970307:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.970320:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.970330:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.970339:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762954.970343:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.970350:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.970364:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762954.970369:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762954.970426:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246658432:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5263us (47965us total) trans 4294967663 rc 0/0 00000100:00100000:3.0:1789762954.970436:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:3.0:1789762954.970447:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257402298700 time 257402371734 state 0x2 ref 0 00000100:00100000:0.0:1789762954.972684:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762954.972729:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658560 00000100:00100000:2.0:1789762954.972737:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658560 00000100:00100000:2.0:1789762954.972797:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257402298700 time 257402371734 state 0x0 ref 1 00000100:00100000:2.0:1789762954.972811:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257452371734 time 257402371734 state 0x1 ref 1 00000100:00100000:3.0:1789762955.015211:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257452371734 time 257452444265 state 0x0 ref 1 00000100:00100000:3.0:1789762955.015243:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246658560:12345-192.168.203.36@tcp:4:dd.0 00000100:00080000:1.0:1789762955.015278:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789762955.015291:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 25165824, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xc000 00010000:00010000:3.0:1789762955.015302:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.015319:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1789762955.015324:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.015332:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.015346:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.020358:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967664 is committed 00002000:00010000:3.0:1789762955.020428:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:3.0:1789762955.020433:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 49152 -> 51200 00010000:00010000:3.0:1789762955.020441:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.020454:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.020464:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.020485:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762955.020504:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.020513:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.020527:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.020533:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.020586:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246658560:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5360us (47902us total) trans 4294967664 rc 0/0 00000100:00100000:3.0:1789762955.020593:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 238 00000100:00100000:3.0:1789762955.020601:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257452371734 time 257452444265 state 0x2 ref 0 00000100:00100000:2.0:1789762955.022911:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762955.022977:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658688 00000100:00100000:1.0:1789762955.022985:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658688 00000100:00100000:1.0:1789762955.023022:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257452371734 time 257452444265 state 0x0 ref 1 00000100:00100000:1.0:1789762955.023036:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257502444265 time 257452444265 state 0x1 ref 1 00000100:00100000:2.0:1789762955.065302:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257502444265 time 257502534934 state 0x0 ref 1 00000100:00100000:2.0:1789762955.065340:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246658688:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762955.065387:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 26214400, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xc800 00010000:00010000:2.0:1789762955.065394:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.065407:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1789762955.065411:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.065415:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.065426:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.070333:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967665 is committed 00002000:00010000:3.0:1789762955.070396:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:3.0:1789762955.070402:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 51200 -> 53248 00010000:00010000:3.0:1789762955.070410:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.070419:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.070436:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.070441:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762955.070445:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.070455:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.070472:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.070482:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020aa6457/0x5915dfb1c1b5b5bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.070551:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246658688:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5217us (47642us total) trans 4294967665 rc 0/0 00000100:00100000:3.0:1789762955.070559:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 239 00000100:00100000:3.0:1789762955.070567:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257502444265 time 257502534934 state 0x2 ref 0 00000100:00100000:0.0:1789762955.072898:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762955.072932:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658816 00000100:00100000:3.0:1789762955.072940:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658816 00000100:00100000:3.0:1789762955.072973:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257502444265 time 257502534934 state 0x0 ref 1 00000100:00100000:3.0:1789762955.072999:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257552534934 time 257502534934 state 0x1 ref 1 00000100:00100000:2.0:1789762955.115378:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257552534934 time 257552610228 state 0x0 ref 1 00000100:00100000:2.0:1789762955.115398:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246658816:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762955.115448:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 27262976, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xd000 00010000:00010000:2.0:1789762955.115458:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.115475:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1789762955.115480:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.115486:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.115525:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.120203:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967666 is committed 00002000:00010000:2.0:1789762955.120284:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:2.0:1789762955.120290:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 53248 -> 55296 00010000:00010000:2.0:1789762955.120298:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.120306:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.120312:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.120317:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762955.120321:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.120328:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.120340:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.120345:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b5c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.120401:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246658816:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5008us (47503us total) trans 4294967666 rc 0/0 00000100:00100000:2.0:1789762955.120409:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 240 00000100:00100000:2.0:1789762955.120416:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257552534934 time 257552610228 state 0x2 ref 0 00000100:00100000:0.0:1789762955.122450:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762955.122482:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246658944 00000100:00100000:3.0:1789762955.122505:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246658944 00000100:00100000:3.0:1789762955.122541:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257552534934 time 257552610228 state 0x0 ref 1 00000100:00100000:3.0:1789762955.122552:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257602610228 time 257552610228 state 0x1 ref 1 00010000:00010000:1.0:1789762955.130860:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762955.165477:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257602610228 time 257602710902 state 0x0 ref 1 00000100:00100000:0.0:1789762955.165512:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246658944:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762955.165559:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 28311552, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xd800 00010000:00010000:0.0:1789762955.165566:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.165580:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:0.0:1789762955.165584:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.165588:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.165600:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.170477:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967667 is committed 00002000:00010000:0.0:1789762955.170589:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:0.0:1789762955.170593:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 55296 -> 57344 00010000:00010000:0.0:1789762955.170601:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.170615:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.170621:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.170626:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.170630:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.170636:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.170650:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.170654:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.170704:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246658944:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5212us (48255us total) trans 4294967667 rc 0/0 00000100:00100000:0.0:1789762955.170711:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:0.0:1789762955.170717:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257602610228 time 257602710902 state 0x2 ref 0 00000100:00100000:2.0:1789762955.173168:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762955.173207:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659072 00000100:00100000:3.0:1789762955.173214:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659072 00000100:00100000:3.0:1789762955.173248:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257602610228 time 257602710902 state 0x0 ref 1 00000100:00100000:3.0:1789762955.173259:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257652710902 time 257602710902 state 0x1 ref 1 00000100:00100000:0.0:1789762955.215565:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257652710902 time 257652796906 state 0x0 ref 1 00000100:00100000:0.0:1789762955.215595:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659072:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762955.215639:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 29360128, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xe000 00010000:00010000:0.0:1789762955.215646:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.215659:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:0.0:1789762955.215663:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.215667:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.215678:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.220387:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967668 is committed 00002000:00010000:0.0:1789762955.220481:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:0.0:1789762955.220487:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 57344 -> 59392 00010000:00010000:0.0:1789762955.220512:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.220525:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.220554:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.220565:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.220582:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.220598:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.220624:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.220650:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.220705:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659072:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5113us (47536us total) trans 4294967668 rc 0/0 00000100:00100000:0.0:1789762955.220713:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 242 00000100:00100000:0.0:1789762955.220721:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257652710902 time 257652796906 state 0x2 ref 0 00000100:00100000:2.0:1789762955.223059:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.223161:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659200 00000100:00100000:0.0:1789762955.223174:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659200 00000100:00100000:0.0:1789762955.223227:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257652710902 time 257652796906 state 0x0 ref 1 00000100:00100000:0.0:1789762955.223243:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257702796906 time 257652796906 state 0x1 ref 1 00000100:00100000:1.0:1789762955.265703:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257702796906 time 257702927341 state 0x0 ref 1 00000100:00100000:1.0:1789762955.265736:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246659200:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762955.265847:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 30408704, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xe800 00010000:00010000:1.0:1789762955.265855:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.265878:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:1.0:1789762955.265882:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762955.265886:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.265897:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.271831:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967669 is committed 00002000:00010000:0.0:1789762955.271890:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:0.0:1789762955.271895:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 59392 -> 61440 00010000:00010000:0.0:1789762955.271903:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.271922:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.271928:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.271933:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.271937:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.271944:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.271957:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.271962:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5b5db lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.272011:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246659200:12345-192.168.203.36@tcp:4:dd.0 Request processed in 6288us (48955us total) trans 4294967669 rc 0/0 00000100:00100000:0.0:1789762955.272018:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 243 00000100:00100000:0.0:1789762955.272026:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257702796906 time 257702927341 state 0x2 ref 0 00000100:00100000:2.0:1789762955.274881:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.274914:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659328 00000100:00100000:0.0:1789762955.274928:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659328 00000100:00100000:0.0:1789762955.274961:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257702796906 time 257702927341 state 0x0 ref 1 00000100:00100000:0.0:1789762955.274971:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257752927341 time 257702927341 state 0x1 ref 1 00000100:00100000:0.0:1789762955.315813:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257752927341 time 257753042495 state 0x0 ref 1 00000100:00100000:0.0:1789762955.315840:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659328:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762955.315887:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 31457280, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xf000 00010000:00010000:0.0:1789762955.315898:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.315916:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:0.0:1789762955.315922:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.315929:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.315945:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.322657:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967670 is committed 00002000:00010000:0.0:1789762955.322851:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789762955.322856:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 61440 -> 63488 00010000:00010000:0.0:1789762955.322865:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.322873:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.322887:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.322892:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.322895:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.322902:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.322913:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.322918:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c22309/0x5915dfb1c1b5b5e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.322984:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659328:12345-192.168.203.36@tcp:4:dd.0 Request processed in 7136us (48085us total) trans 4294967670 rc 0/0 00000100:00100000:0.0:1789762955.322999:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 244 00000100:00100000:0.0:1789762955.323013:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257752927341 time 257753042495 state 0x2 ref 0 00000100:00100000:1.0:1789762955.326357:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.326453:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659456 00000100:00100000:0.0:1789762955.326465:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659456 00000100:00100000:0.0:1789762955.326547:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257752927341 time 257753042495 state 0x0 ref 1 00000100:00100000:0.0:1789762955.326566:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257803042495 time 257753042495 state 0x1 ref 1 00000100:00100000:3.0:1789762955.366023:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257803042495 time 257803248116 state 0x0 ref 1 00000100:00100000:3.0:1789762955.366059:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246659456:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762955.366121:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 32505856, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0xf800 00010000:00010000:3.0:1789762955.366133:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.366154:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1789762955.366160:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.366168:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.366203:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.374787:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967671 is committed 00002000:00010000:3.0:1789762955.374911:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:3.0:1789762955.374921:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 63488 -> 65536 00010000:00010000:3.0:1789762955.374935:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.374951:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.374963:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.374972:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762955.374978:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.374990:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.375011:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.375020:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.375123:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246659456:12345-192.168.203.36@tcp:4:dd.0 Request processed in 9075us (48769us total) trans 4294967671 rc 0/0 00000100:00100000:3.0:1789762955.375137:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 245 00000100:00100000:3.0:1789762955.375152:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257803042495 time 257803248116 state 0x2 ref 0 00000100:00100000:2.0:1789762955.379037:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.379135:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659584 00000100:00100000:0.0:1789762955.379149:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659584 00000100:00100000:0.0:1789762955.379208:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257803042495 time 257803248116 state 0x0 ref 1 00000100:00100000:0.0:1789762955.379227:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257853248116 time 257803248116 state 0x1 ref 1 00000100:00100000:3.0:1789762955.416153:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257853248116 time 257853372524 state 0x0 ref 1 00000100:00100000:3.0:1789762955.416186:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659584:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762955.416253:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 33554432, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x10000 00010000:00010000:3.0:1789762955.416268:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.416291:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1789762955.416299:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.416309:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.416330:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.425196:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967672 is committed 00002000:00010000:3.0:1789762955.425319:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:3.0:1789762955.425327:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 65536 -> 67584 00010000:00010000:3.0:1789762955.425342:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.425378:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.425393:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.425404:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762955.425411:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.425424:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.425448:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.425460:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b5f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762955.425561:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659584:12345-192.168.203.36@tcp:4:dd.0 Request processed in 9386us (46526us total) trans 4294967672 rc 0/0 00000100:00100000:3.0:1789762955.425575:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 246 00000100:00100000:3.0:1789762955.425592:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257853248116 time 257853372524 state 0x2 ref 0 00000100:00100000:2.0:1789762955.429863:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.429951:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659712 00000100:00100000:0.0:1789762955.429966:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659712 00000100:00100000:0.0:1789762955.430033:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257853248116 time 257853372524 state 0x0 ref 1 00000100:00100000:0.0:1789762955.430052:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257903372524 time 257853372524 state 0x1 ref 1 00000100:00100000:2.0:1789762955.466281:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257903372524 time 257903507022 state 0x0 ref 1 00000100:00100000:2.0:1789762955.466308:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246659712:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762955.466365:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 34603008, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x10800 00010000:00010000:2.0:1789762955.466377:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.466396:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1789762955.466401:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.466425:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.466456:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.473422:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967673 is committed 00002000:00010000:0.0:1789762955.473539:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:0.0:1789762955.473547:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 67584 -> 69632 00010000:00010000:0.0:1789762955.473557:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.473570:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.473578:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.473585:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.473598:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.473607:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.473623:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.473630:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b5f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.473697:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246659712:12345-192.168.203.36@tcp:4:dd.0 Request processed in 7397us (43844us total) trans 4294967673 rc 0/0 00000100:00100000:0.0:1789762955.473707:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 247 00000100:00100000:0.0:1789762955.473717:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257903372524 time 257903507022 state 0x2 ref 0 00000100:00100000:2.0:1789762955.476530:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762955.476583:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659840 00000100:00100000:3.0:1789762955.476601:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659840 00000100:00100000:3.0:1789762955.476643:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257903372524 time 257903507022 state 0x0 ref 1 00000100:00100000:3.0:1789762955.476656:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257953507022 time 257903507022 state 0x1 ref 1 00000100:00100000:2.0:1789762955.516375:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257953507022 time 257953608673 state 0x0 ref 1 00000100:00100000:2.0:1789762955.516399:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246659840:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762955.516444:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 35651584, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x11000 00010000:00010000:2.0:1789762955.516451:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.516464:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1789762955.516467:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.516472:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.516482:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.521499:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967674 is committed 00002000:00010000:0.0:1789762955.521562:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:0.0:1789762955.521567:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 69632 -> 71680 00010000:00010000:0.0:1789762955.521575:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.521584:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.521590:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.521605:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.521609:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.521615:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.521628:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.521633:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055f759f1/0x5915dfb1c1b5b5fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.521685:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246659840:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5294us (45156us total) trans 4294967674 rc 0/0 00000100:00100000:0.0:1789762955.521691:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 248 00000100:00100000:0.0:1789762955.521698:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257953507022 time 257953608673 state 0x2 ref 0 00000100:00100000:1.0:1789762955.524062:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762955.524103:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246659968 00000100:00100000:3.0:1789762955.524112:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246659968 00000100:00100000:3.0:1789762955.524147:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 257953507022 time 257953608673 state 0x0 ref 1 00000100:00100000:3.0:1789762955.524158:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258003608673 time 257953608673 state 0x1 ref 1 00000100:00100000:2.0:1789762955.566483:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258003608673 time 258003718491 state 0x0 ref 1 00000100:00100000:2.0:1789762955.566511:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c5e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659968:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762955.566549:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 36700160, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x11800 00010000:00010000:2.0:1789762955.566556:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.566582:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762955.566586:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.566590:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.566601:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.571180:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967675 is committed 00002000:00010000:0.0:1789762955.571252:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:0.0:1789762955.571257:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 71680 -> 73728 00010000:00010000:0.0:1789762955.571265:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.571274:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.571291:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.571297:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.571300:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.571307:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.571320:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.571326:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086953018/0x5915dfb1c1b5b605 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.571377:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c5e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246659968:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4870us (47315us total) trans 4294967675 rc 0/0 00000100:00100000:0.0:1789762955.571384:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 249 00000100:00100000:0.0:1789762955.571392:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258003608673 time 258003718491 state 0x2 ref 0 00000100:00100000:2.0:1789762955.574181:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.574253:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660096 00000100:00100000:0.0:1789762955.574262:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660096 00000100:00100000:0.0:1789762955.574295:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258003608673 time 258003718491 state 0x0 ref 1 00000100:00100000:0.0:1789762955.574315:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258053718491 time 258003718491 state 0x1 ref 1 00000100:00100000:0.0:1789762955.616562:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258053718491 time 258053795337 state 0x0 ref 1 00000100:00100000:0.0:1789762955.616581:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660096:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762955.616627:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 37748736, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x12000 00010000:00010000:0.0:1789762955.616634:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.616648:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1789762955.616652:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.616656:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.616666:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.621635:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967676 is committed 00002000:00010000:0.0:1789762955.621704:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:0.0:1789762955.621709:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 73728 -> 75776 00010000:00010000:0.0:1789762955.621718:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.621726:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.621743:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.621765:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767dc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.621768:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.621775:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.621790:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.621796:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b60c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.621847:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660096:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5271us (47666us total) trans 4294967676 rc 0/0 00000100:00100000:0.0:1789762955.621854:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 250 00000100:00100000:0.0:1789762955.621863:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258053718491 time 258053795337 state 0x2 ref 0 00000100:00100000:2.0:1789762955.624299:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.624345:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660224 00000100:00100000:0.0:1789762955.624352:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660224 00000100:00100000:0.0:1789762955.624387:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258053718491 time 258053795337 state 0x0 ref 1 00000100:00100000:0.0:1789762955.624418:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258103795337 time 258053795337 state 0x1 ref 1 00000100:00100000:0.0:1789762955.666641:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258103795337 time 258103872624 state 0x0 ref 1 00000100:00100000:0.0:1789762955.666663:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660224:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762955.666711:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 38797312, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x12800 00010000:00010000:0.0:1789762955.666718:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.666732:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1789762955.666736:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.666740:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.666783:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.672384:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967677 is committed 00002000:00010000:0.0:1789762955.672483:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:0.0:1789762955.672502:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 75776 -> 77824 00010000:00010000:0.0:1789762955.672511:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.672520:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.672538:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.672543:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767dc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.672546:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.672553:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.672566:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.672571:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000814531fe/0x5915dfb1c1b5b613 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.672626:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660224:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5970us (48327us total) trans 4294967677 rc 0/0 00000100:00100000:0.0:1789762955.672633:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 251 00000100:00100000:0.0:1789762955.672642:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258103795337 time 258103872624 state 0x2 ref 0 00000100:00100000:1.0:1789762955.675371:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.675440:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660352 00000100:00100000:0.0:1789762955.675450:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660352 00000100:00100000:0.0:1789762955.675514:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258103795337 time 258103872624 state 0x0 ref 1 00000100:00100000:0.0:1789762955.675554:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258153872624 time 258103872624 state 0x1 ref 1 00000100:00100000:3.0:1789762955.716827:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258153872624 time 258154054275 state 0x0 ref 1 00000100:00100000:3.0:1789762955.716855:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246660352:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762955.716911:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 39845888, mtime: 0x6aad9d8b, atime: 0x0, ctime: 0x6aad9d8b, blocks: 0x13000 00010000:00010000:3.0:1789762955.716940:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.716958:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:3.0:1789762955.716964:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.716971:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.716987:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.726691:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967678 is committed 00002000:00010000:3.0:1789762955.726841:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:3.0:1789762955.726850:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 1789762955 -> 1789762956 00002000:00010000:3.0:1789762955.726855:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 1789762955 -> 1789762956 00002000:00010000:3.0:1789762955.726858:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 77824 -> 79872 00010000:00010000:3.0:1789762955.726891:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.726908:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.726920:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.726928:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762955.726934:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.726944:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.726966:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.726976:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b61a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.727200:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246660352:12345-192.168.203.36@tcp:4:dd.0 Request processed in 10346us (51821us total) trans 4294967678 rc 0/0 00000100:00100000:2.0:1789762955.727217:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 252 00000100:00100000:2.0:1789762955.727231:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258153872624 time 258154054275 state 0x2 ref 0 00000100:00100000:2.0:1789762955.731304:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.731393:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660480 00000100:00100000:0.0:1789762955.731407:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660480 00000100:00100000:0.0:1789762955.731472:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258153872624 time 258154054275 state 0x0 ref 1 00000100:00100000:0.0:1789762955.731520:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258204054275 time 258154054275 state 0x1 ref 1 00000100:00100000:3.0:1789762955.766945:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258204054275 time 258204177430 state 0x0 ref 1 00000100:00100000:3.0:1789762955.766969:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660480:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762955.767023:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 40894464, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x13800 00010000:00010000:3.0:1789762955.767033:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.767049:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:3.0:1789762955.767054:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762955.767061:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762955.767075:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.774820:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967679 is committed 00002000:00010000:2.0:1789762955.774932:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:2.0:1789762955.774939:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 79872 -> 81920 00010000:00010000:2.0:1789762955.774951:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.774964:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.774973:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.774992:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762955.774997:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.775006:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.775022:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.775030:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5b621 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762955.775102:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660480:12345-192.168.203.36@tcp:4:dd.0 Request processed in 8139us (43801us total) trans 4294967679 rc 0/0 00000100:00100000:2.0:1789762955.775113:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 253 00000100:00100000:2.0:1789762955.775124:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258204054275 time 258204177430 state 0x2 ref 0 00000100:00100000:0.0:1789762955.778509:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762955.778620:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660608 00000100:00100000:3.0:1789762955.778634:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660608 00000100:00100000:3.0:1789762955.778689:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258204054275 time 258204177430 state 0x0 ref 1 00000100:00100000:3.0:1789762955.778707:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258254177430 time 258204177430 state 0x1 ref 1 00000100:00100000:2.0:1789762955.817120:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258254177430 time 258254345267 state 0x0 ref 1 00000100:00100000:2.0:1789762955.817155:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246660608:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762955.817220:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 41943040, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x14000 00010000:00010000:2.0:1789762955.817232:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.817270:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762955.817276:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.817285:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.817302:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.826952:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967680 is committed 00002000:00010000:0.0:1789762955.827118:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:0.0:1789762955.827129:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 81920 -> 83968 00010000:00010000:0.0:1789762955.827147:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.827163:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.827174:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.827183:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.827189:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.827201:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.827237:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.827248:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.827340:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246660608:12345-192.168.203.36@tcp:4:dd.0 Request processed in 10195us (48854us total) trans 4294967680 rc 0/0 00000100:00100000:0.0:1789762955.827354:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 254 00000100:00100000:0.0:1789762955.827369:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258254177430 time 258254345267 state 0x2 ref 0 00000100:00100000:1.0:1789762955.831481:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762955.831590:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660736 00000100:00100000:2.0:1789762955.831604:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660736 00000100:00100000:2.0:1789762955.831667:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258254177430 time 258254345267 state 0x0 ref 1 00000100:00100000:2.0:1789762955.831687:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258304345267 time 258254345267 state 0x1 ref 1 00000100:00100000:2.0:1789762955.867204:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258304345267 time 258304433498 state 0x0 ref 1 00000100:00100000:2.0:1789762955.867231:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660736:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762955.867286:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 42991616, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x14800 00010000:00010000:2.0:1789762955.867298:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.867318:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762955.867325:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762955.867333:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762955.867366:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762955.876269:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967681 is committed 00002000:00010000:0.0:1789762955.876446:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:0.0:1789762955.876455:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 83968 -> 86016 00010000:00010000:0.0:1789762955.876469:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.876511:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.876530:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.876540:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.876545:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.876579:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.876603:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.876614:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b62f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.876709:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660736:12345-192.168.203.36@tcp:4:dd.0 Request processed in 9482us (45237us total) trans 4294967681 rc 0/0 00000100:00100000:0.0:1789762955.876721:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 255 00000100:00100000:0.0:1789762955.876736:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258304345267 time 258304433498 state 0x2 ref 0 00000100:00100000:1.0:1789762955.880946:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762955.881041:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660864 00000100:00100000:2.0:1789762955.881070:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660864 00000100:00100000:2.0:1789762955.881129:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258304345267 time 258304433498 state 0x0 ref 1 00000100:00100000:2.0:1789762955.881148:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258354433498 time 258304433498 state 0x1 ref 1 00000100:00100000:0.0:1789762955.917402:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258354433498 time 258354626082 state 0x0 ref 1 00000100:00100000:0.0:1789762955.917437:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246660864:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762955.917525:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 44040192, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x15000 00010000:00010000:0.0:1789762955.917539:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.917557:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1789762955.917563:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.917582:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.917615:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762955.927669:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967682 is committed 00002000:00010000:1.0:1789762955.927854:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:1.0:1789762955.927875:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 86016 -> 88064 00010000:00010000:1.0:1789762955.927892:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.927908:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.927920:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.927929:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762955.927935:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.927947:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.927970:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762955.927986:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b636 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762955.928107:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246660864:12345-192.168.203.36@tcp:4:dd.0 Request processed in 10677us (47163us total) trans 4294967682 rc 0/0 00000100:00100000:1.0:1789762955.928123:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 256 00000100:00100000:1.0:1789762955.928139:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258354433498 time 258354626082 state 0x2 ref 0 00000100:00100000:2.0:1789762955.932610:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.932710:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246660992 00000100:00100000:0.0:1789762955.932724:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246660992 00000100:00100000:0.0:1789762955.932829:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258354433498 time 258354626082 state 0x0 ref 1 00000100:00100000:0.0:1789762955.932848:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258404626082 time 258354626082 state 0x1 ref 1 00000100:00100000:0.0:1789762955.967534:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258404626082 time 258404764286 state 0x0 ref 1 00000100:00100000:0.0:1789762955.967563:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660992:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762955.967616:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 45088768, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x15800 00010000:00010000:0.0:1789762955.967628:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.967647:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1789762955.967653:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762955.967660:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.967678:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762955.976565:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967683 is committed 00002000:00010000:0.0:1789762955.976740:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1789762955.976782:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 88064 -> 90112 00010000:00010000:0.0:1789762955.976797:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.976814:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.976825:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.976835:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767cc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762955.976841:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.976852:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.976872:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762955.976882:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b63d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762955.976988:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246660992:12345-192.168.203.36@tcp:4:dd.0 Request processed in 9428us (44376us total) trans 4294967683 rc 0/0 00000100:00100000:0.0:1789762955.977021:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 257 00000100:00100000:0.0:1789762955.977038:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258404626082 time 258404764286 state 0x2 ref 0 00000100:00100000:2.0:1789762955.981134:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762955.981226:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246661120 00000100:00100000:0.0:1789762955.981240:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246661120 00000100:00100000:0.0:1789762955.981298:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258404626082 time 258404764286 state 0x0 ref 1 00000100:00100000:0.0:1789762955.981317:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258454764286 time 258404764286 state 0x1 ref 1 00000100:00100000:3.0:1789762956.017715:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258454764286 time 258454945544 state 0x0 ref 1 00000100:00100000:3.0:1789762956.017808:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246661120:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762956.017863:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 46137344, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x16000 00010000:00010000:3.0:1789762956.017874:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.017893:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:3.0:1789762956.017899:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.017906:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.017924:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.027803:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967684 is committed 00002000:00010000:3.0:1789762956.027944:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:3.0:1789762956.027954:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 90112 -> 92160 00010000:00010000:3.0:1789762956.027970:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.027986:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.027998:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.028007:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762956.028025:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.028037:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.028059:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.028069:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b644 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.028167:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246661120:12345-192.168.203.36@tcp:4:dd.0 Request processed in 10410us (47033us total) trans 4294967684 rc 0/0 00000100:00100000:3.0:1789762956.028180:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 258 00000100:00100000:3.0:1789762956.028195:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258454764286 time 258454945544 state 0x2 ref 0 00000100:00100000:2.0:1789762956.031947:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762956.032089:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246661248 00000100:00100000:1.0:1789762956.032105:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246661248 00000100:00100000:1.0:1789762956.032180:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258454764286 time 258454945544 state 0x0 ref 1 00000100:00100000:1.0:1789762956.032203:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258504945544 time 258454945544 state 0x1 ref 1 00000100:00100000:2.0:1789762956.067886:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258504945544 time 258505110705 state 0x0 ref 1 00000100:00100000:2.0:1789762956.067921:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246661248:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.067989:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 47185920, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x16800 00010000:00010000:2.0:1789762956.068023:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.068051:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762956.068061:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.068073:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.068128:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.077192:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967685 is committed 00002000:00010000:0.0:1789762956.077349:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:0.0:1789762956.077362:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 92160 -> 94208 00010000:00010000:0.0:1789762956.077382:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.077405:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.077424:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.077439:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.077448:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.077461:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.077528:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.077539:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b64b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.077643:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246661248:12345-192.168.203.36@tcp:4:dd.0 Request processed in 9732us (45699us total) trans 4294967685 rc 0/0 00000100:00100000:0.0:1789762956.077655:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 259 00000100:00100000:0.0:1789762956.077668:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258504945544 time 258505110705 state 0x2 ref 0 00000100:00100000:1.0:1789762956.081677:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.081748:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246661376 00000100:00100000:0.0:1789762956.081801:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246661376 00000100:00100000:0.0:1789762956.081863:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258504945544 time 258505110705 state 0x0 ref 1 00000100:00100000:0.0:1789762956.081882:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258555110705 time 258505110705 state 0x1 ref 1 00000004:00080000:0.0:1789762956.091048:0:8698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 258528293628ns, next at 259528288254ns, rc = 0 00000100:00100000:3.0:1789762956.091058:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254932992:0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.091110:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254933376:0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.091157:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c212b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254933248:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.091159:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762956.091211:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762956.091271:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762956.091287:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c212a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254933504:0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.091332:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254933376 00000100:00100000:1.0:1789762956.091342:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254933376 00000100:00100000:2.0:1789762956.091344:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254933632:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.091362:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762956.091430:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254933248 00000100:00100000:1.0:1789762956.091440:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254933248 00000100:00100000:2.0:1789762956.091440:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762956.091447:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254932992 00000100:00100000:3.0:1789762956.091457:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254932992 00000100:00100000:1.0:1789762956.091528:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254933632 00000100:00100000:1.0:1789762956.091537:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254933632 00000100:00100000:2.0:1789762956.091537:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789762956.091560:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789762956.091563:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254933120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762956.091585:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.091611:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789762956.091627:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789762956.091637:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254933376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.091641:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762956.091660:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254933248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.091721:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c212ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254933760:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.091722:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254932992:12345-0@lo:400:kworker.0 Request processed in 143us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.091797:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789762956.091805:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254933376:12345-0@lo:400:kworker.0 Request processed in 176us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762956.091824:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789762956.091825:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254933248:12345-0@lo:400:kworker.0 Request processed in 170us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762956.091844:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789762956.091858:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762956.091876:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789762956.091890:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254933504 00000100:00100000:1.0:1789762956.091900:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254933632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.091902:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254933504 00000100:00100000:2.0:1789762956.091963:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c212b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254933248:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.091991:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254933760 00000100:00100000:1.0:1789762956.091994:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254933632:12345-0@lo:400:kworker.0 Request processed in 101us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.092003:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254933760 00000100:00100000:2.0:1789762956.092014:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254933632:0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.092039:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789762956.092090:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789762956.092114:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254933504:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762956.092118:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762956.092131:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789762956.092141:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762956.092156:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254933120 00000100:00100000:2.0:1789762956.092170:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254933120 00000100:00100000:3.0:1789762956.092196:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254933504:12345-0@lo:400:kworker.0 Request processed in 88us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.092210:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789762956.092221:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254933376:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.092253:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789762956.092263:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789762956.092274:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254933760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.092295:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254933120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789762956.092343:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50659904 pending 16875520 free 3906891776 avail 3675369472 00000100:00100000:0.0:1789762956.092370:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c212a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254933504:0@lo:400:kworker.0 00000100:00100000:3.0:1789762956.092385:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254933760:12345-0@lo:400:kworker.0 Request processed in 116us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.092401:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789762956.092431:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c212ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254933760:0@lo:400:kworker.0 00000100:00100000:2.0:1789762956.092451:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254933120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762956.092471:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789762956.092479:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254932992:0@lo:400:kworker.0 00000100:00100000:1.0:1789762956.092518:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254933120:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789762956.092988:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000001:00080000:0.0:1789762956.093013:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967480 is committed 00000004:00080000:0.0:1789762956.093038:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:0.0:1789762956.093041:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000100:00100000:0.0:1789762956.093244:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254934016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762956.093283:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789762956.093306:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762956.093307:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254933888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762956.093330:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c212b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254934144:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789762956.093362:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254934016 00000100:00100000:3.0:1789762956.093371:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254934016 00000100:00100000:1.0:1789762956.093389:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762956.093443:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254933888 00000100:00100000:3.0:1789762956.093451:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254933888 00000100:00100000:0.0:1789762956.093477:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789762956.093522:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254934016:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789762956.093536:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00002000:00080000:0.0:1789762956.093550:0:12136:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:11 count 1 00000100:00100000:2.0:1789762956.093562:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254933888:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789762956.093578:0:12136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789762956.093598:0:6909:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:9 count 1 00000100:00100000:3.0:1789762956.093602:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789762956.093606:0:12136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 8 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.093625:0:12136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 8 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.093636:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1789762956.093643:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1789762956.093645:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 8388608, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x4000 00010000:00010000:0.0:1789762956.093650:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 5/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.093666:0:6909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762956.093687:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254934144 00010000:00010000:2.0:1789762956.093691:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1789762956.093698:0:12136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 8 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762956.093699:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254934144 00010000:00010000:2.0:1789762956.093703:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.093727:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762956.093793:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789762956.093821:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254934144:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789762956.093839:0:6909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.093840:0:12136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 8 pid: 12136 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789762956.093848:0:6911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:10 count 1 00010000:00010000:1.0:1789762956.093875:0:6911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.093900:0:6909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.093913:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 13 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.093933:0:12136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c447ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12136:1876702254934272:192.168.203.36@tcp:104: 00010000:00010000:2.0:1789762956.093940:0:6909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.093952:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1789762956.093967:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789762956.093985:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.094009:0:6909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789762956.094051:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 13 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.094069:0:12136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 8 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.094073:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 13 pid: 12943 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.094081:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789762956.094104:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.094126:0:12136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 8 pid: 7959 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762956.094137:0:6911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33f7468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1876702254934400:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762956.094140:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762956.094155:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.094174:0:12136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4478700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12136:1876702254934528:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762956.094199:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762956.094217:0:6911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33c3574d80 going to sleep for 11 seconds 00010000:00010000:3.0:1789762956.094225:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.094232:0:12136:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b33feaf1900 going to sleep for 11 seconds 00010000:00010000:3.0:1789762956.094248:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b659 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762956.094251:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3419:x1876702254933888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 694us (860us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789762956.094289:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:3.0:1789762956.094310:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762956.094318:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762956.094325:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789762956.094328:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c2128000/2, rc 0, transno 4294967336 00000100:00100000:0.0:1789762956.094343:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254933888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789762956.096188:0:12136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c447ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12136:1876702254934272:192.168.203.36@tcp:104: 00000100:00100000:3.0:1789762956.096213:0:6911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33f7468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1876702254934400:192.168.203.36@tcp:104: 00000100:00100000:0.0:1789762956.096225:0:12136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4478700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12136:1876702254934528:192.168.203.36@tcp:104: 00010000:00010000:3.0:1789762956.096249:0:6911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.096263:0:12136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762956.096538:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762956.096574:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762956.096614:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762956.096653:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246661632 00000100:00100000:0.0:1789762956.096664:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246661504 00000100:00100000:2.0:1789762956.096666:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246661632 00000100:00100000:0.0:1789762956.096676:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246661504 00000100:00100000:3.0:1789762956.096686:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246661760 00000100:00100000:3.0:1789762956.096698:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246661760 00010000:00010000:0.0:1789762956.096721:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 10 pid: 12136 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.096741:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 10 pid: 7959 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.096748:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 14 pid: 12943 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789762956.096788:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789762956.096856:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:3.0:1789762956.096876:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246661760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789762956.096888:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00010000:00010000:3.0:1789762956.096894:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789762956.096905:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:1.0:1789762956.096916:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2354:x1876702246661504:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789762956.096926:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 10 pid: 7959 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.096939:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246661632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762956.096942:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762956.096964:0:5954:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 10 pid: 12136 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.096965:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 10 pid: 7959 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.096969:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762956.096994:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 14 pid: 12943 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097033:0:5954:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 10 pid: 12136 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.097043:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 14 pid: 12943 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.097078:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005be82069/0x5915dfb1c1b5b396 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448e8 expref: 10 pid: 7959 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097096:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd54d970/0x5915dfb1c1b5b3b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448ef expref: 10 pid: 12136 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.097097:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002698e957/0x5915dfb1c1b5b31f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b0 expref: 14 pid: 12943 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.097115:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.097135:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.097154:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.097162:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789762956.097184:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789762956.097207:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.097208:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.097252:0:5911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097252:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762956.097281:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762956.097299:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762956.097318:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246661504:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 412us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762956.097334:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:3.0:1789762956.097343:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246661760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 465us (721us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762956.097356:0:12136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.097359:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2353:x1876702246661632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 429us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.097367:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:0.0:1789762956.097398:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00010000:00010000:2.0:1789762956.097401:0:12136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.097428:0:6911:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.097433:0:12136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.097463:0:6911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.097473:0:12136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.097537:0:6911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.097548:0:12136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789762956.097549:0:6911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097567:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789762956.097592:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097605:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767cc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762956.097611:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097628:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.097629:0:8854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762956.097646:0:8854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097658:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.097659:0:6911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789762956.097663:0:8854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.097676:0:8854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097682:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b652 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.097703:0:8854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097725:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762956.097731:0:8854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.097734:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762956.097744:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762956.097795:0:8854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b660 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762956.097830:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254934016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4244us (4458us total) trans 4294967686 rc 0/0 00010000:00010000:0.0:1789762956.097851:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762956.097852:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00010000:0.0:1789762956.097863:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762956.097873:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762956.097897:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3418:x1876702254934144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4082us (4296us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789762956.097911:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000004:00080000:1.0:1789762956.097915:0:3420:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c2161c00/2, rc 0, transno 4294967686 00000100:00100000:1.0:1789762956.097956:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254934016:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789762956.097967:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c212b480/2, rc 0, transno 4294967337 00000100:00100000:0.0:1789762956.097984:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c212b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254934144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789762956.117976:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258555110705 time 258555209946 state 0x0 ref 1 00000100:00100000:2.0:1789762956.117997:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246661376:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.118034:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 48234496, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x17000 00010000:00010000:2.0:1789762956.118044:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.118067:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762956.118072:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.118080:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.118095:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.123529:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967687 is committed 00000001:00080000:1.0:1789762956.123539:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967686 is committed 00002000:00010000:3.0:1789762956.123611:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789762956.123618:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 94208 -> 96256 00010000:00010000:3.0:1789762956.123627:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.123637:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.123644:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.123650:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762956.123653:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.123673:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.123685:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.123691:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026ae6af/0x5915dfb1c1b5b667 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.123746:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246661376:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5754us (42074us total) trans 4294967687 rc 0/0 00000100:00100000:3.0:1789762956.123790:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 260 00000100:00100000:3.0:1789762956.123799:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258555110705 time 258555209946 state 0x2 ref 0 00000100:00100000:2.0:1789762956.126070:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762956.126114:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246661888 00000100:00100000:3.0:1789762956.126122:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246661888 00000100:00100000:3.0:1789762956.126159:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258555110705 time 258555209946 state 0x0 ref 1 00000100:00100000:3.0:1789762956.126171:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258605209946 time 258555209946 state 0x1 ref 1 00010000:00010000:1.0:1789762956.154847:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762956.168068:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258605209946 time 258605305565 state 0x0 ref 1 00000100:00100000:0.0:1789762956.168085:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246661888:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762956.168121:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 49283072, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x17800 00010000:00010000:0.0:1789762956.168138:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.168149:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1789762956.168152:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.168157:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.168166:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.173980:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967688 is committed 00002000:00010000:0.0:1789762956.174044:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:0.0:1789762956.174049:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 96256 -> 98304 00010000:00010000:0.0:1789762956.174057:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.174066:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.174072:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.174077:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.174081:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.174087:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.174106:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.174111:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b66e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.174157:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246661888:12345-192.168.203.36@tcp:4:dd.0 Request processed in 6077us (48091us total) trans 4294967688 rc 0/0 00000100:00100000:0.0:1789762956.174165:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 261 00000100:00100000:0.0:1789762956.174172:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258605209946 time 258605305565 state 0x2 ref 0 00000100:00100000:2.0:1789762956.176224:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.176291:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662016 00000100:00100000:0.0:1789762956.176298:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662016 00000100:00100000:0.0:1789762956.176330:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258605209946 time 258605305565 state 0x0 ref 1 00000100:00100000:0.0:1789762956.176339:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258655305565 time 258605305565 state 0x1 ref 1 00000100:00100000:2.0:1789762956.218162:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258655305565 time 258655391446 state 0x0 ref 1 00000100:00100000:2.0:1789762956.218188:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662016:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.218239:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 50331648, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x18000 00010000:00010000:2.0:1789762956.218247:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.218263:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762956.218267:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.218274:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.218288:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.224199:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967689 is committed 00002000:00010000:0.0:1789762956.224288:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:0.0:1789762956.224295:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 98304 -> 100352 00010000:00010000:0.0:1789762956.224309:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.224322:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.224349:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.224357:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.224363:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.224375:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.224395:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.224404:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b675 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.224476:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662016:12345-192.168.203.36@tcp:4:dd.0 Request processed in 6294us (48251us total) trans 4294967689 rc 0/0 00000100:00100000:0.0:1789762956.224502:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 262 00000100:00100000:0.0:1789762956.224514:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258655305565 time 258655391446 state 0x2 ref 0 00000100:00100000:1.0:1789762956.226819:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762956.226873:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662144 00000100:00100000:3.0:1789762956.226881:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662144 00000100:00100000:3.0:1789762956.226918:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258655305565 time 258655391446 state 0x0 ref 1 00000100:00100000:3.0:1789762956.226929:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258705391446 time 258655391446 state 0x1 ref 1 00000100:00100000:1.0:1789762956.268271:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258705391446 time 258705503726 state 0x0 ref 1 00000100:00100000:1.0:1789762956.268291:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662144:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762956.268336:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 51380224, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x18800 00010000:00010000:1.0:1789762956.268343:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.268355:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:1.0:1789762956.268359:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762956.268364:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.268374:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.273417:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967690 is committed 00002000:00010000:0.0:1789762956.273505:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:0.0:1789762956.273509:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 100352 -> 102400 00010000:00010000:0.0:1789762956.273518:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.273536:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.273542:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.273547:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.273551:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.273558:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.273570:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.273575:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b67c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.273626:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662144:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5339us (46808us total) trans 4294967690 rc 0/0 00000100:00100000:0.0:1789762956.273633:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 263 00000100:00100000:0.0:1789762956.273640:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258705391446 time 258705503726 state 0x2 ref 0 00000100:00100000:2.0:1789762956.275822:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.275855:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662272 00000100:00100000:0.0:1789762956.275879:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662272 00000100:00100000:0.0:1789762956.275922:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258705391446 time 258705503726 state 0x0 ref 1 00000100:00100000:0.0:1789762956.275938:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258755503726 time 258705503726 state 0x1 ref 1 00000100:00100000:1.0:1789762956.318382:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258755503726 time 258755614074 state 0x0 ref 1 00000100:00100000:1.0:1789762956.318404:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662272:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762956.318460:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 52428800, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x19000 00010000:00010000:1.0:1789762956.318468:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.318493:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:1.0:1789762956.318497:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762956.318502:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.318514:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.323125:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967691 is committed 00002000:00010000:0.0:1789762956.323201:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:0.0:1789762956.323207:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 102400 -> 104448 00010000:00010000:0.0:1789762956.323216:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.323224:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.323231:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.323235:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.323239:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.323245:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.323259:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.323264:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b683 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.323322:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662272:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4924us (47500us total) trans 4294967691 rc 0/0 00000100:00100000:0.0:1789762956.323329:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 264 00000100:00100000:0.0:1789762956.323337:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258755503726 time 258755614074 state 0x2 ref 0 00000100:00100000:2.0:1789762956.325675:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.325722:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662400 00000100:00100000:0.0:1789762956.325730:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662400 00000100:00100000:0.0:1789762956.325787:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258755503726 time 258755614074 state 0x0 ref 1 00000100:00100000:0.0:1789762956.325798:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258805614074 time 258755614074 state 0x1 ref 1 00000100:00100000:1.0:1789762956.368471:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258805614074 time 258805704158 state 0x0 ref 1 00000100:00100000:1.0:1789762956.368509:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662400:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762956.368554:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 53477376, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x19800 00010000:00010000:1.0:1789762956.368561:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.368574:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:1.0:1789762956.368577:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762956.368582:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.368593:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.373800:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967692 is committed 00002000:00010000:3.0:1789762956.373866:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:3.0:1789762956.373871:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 104448 -> 106496 00010000:00010000:3.0:1789762956.373879:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.373888:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.373894:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.373899:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762956.373902:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.373909:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.373922:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.373927:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c409a5/0x5915dfb1c1b5b68a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.373976:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662400:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5474us (48304us total) trans 4294967692 rc 0/0 00000100:00100000:3.0:1789762956.373994:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 265 00000100:00100000:3.0:1789762956.374002:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258805614074 time 258805704158 state 0x2 ref 0 00000100:00100000:2.0:1789762956.376229:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.376312:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662528 00000100:00100000:0.0:1789762956.376320:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662528 00000100:00100000:0.0:1789762956.376356:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258805614074 time 258805704158 state 0x0 ref 1 00000100:00100000:0.0:1789762956.376367:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258855704158 time 258805704158 state 0x1 ref 1 00000100:00100000:2.0:1789762956.418566:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258855704158 time 258855796734 state 0x0 ref 1 00000100:00100000:2.0:1789762956.418587:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662528:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.418637:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 54525952, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x1a000 00010000:00010000:2.0:1789762956.418647:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.418661:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762956.418665:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.418669:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.418681:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.423418:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967693 is committed 00002000:00010000:0.0:1789762956.423502:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:0.0:1789762956.423506:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 106496 -> 108544 00010000:00010000:0.0:1789762956.423515:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.423523:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.423539:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.423544:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.423547:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.423553:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.423568:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.423573:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b691 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.423623:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662528:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5042us (47395us total) trans 4294967693 rc 0/0 00000100:00100000:0.0:1789762956.423630:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 266 00000100:00100000:0.0:1789762956.423637:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258855704158 time 258855796734 state 0x2 ref 0 00000100:00100000:1.0:1789762956.426073:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.426111:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662656 00000100:00100000:0.0:1789762956.426119:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662656 00000100:00100000:0.0:1789762956.426168:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258855704158 time 258855796734 state 0x0 ref 1 00000100:00100000:0.0:1789762956.426187:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258905796734 time 258855796734 state 0x1 ref 1 00000100:00100000:3.0:1789762956.468656:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258905796734 time 258905887825 state 0x0 ref 1 00000100:00100000:3.0:1789762956.468676:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662656:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762956.468721:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 55574528, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x1a800 00010000:00010000:3.0:1789762956.468728:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.468741:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:3.0:1789762956.468745:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.468767:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.468779:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.473936:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967694 is committed 00002000:00010000:2.0:1789762956.474037:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:2.0:1789762956.474043:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 108544 -> 110592 00010000:00010000:2.0:1789762956.474054:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.474066:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.474091:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.474098:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762956.474103:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.474113:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.474131:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.474140:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b698 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762956.474214:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f746aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662656:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5542us (48151us total) trans 4294967694 rc 0/0 00000100:00100000:2.0:1789762956.474224:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 267 00000100:00100000:2.0:1789762956.474235:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258905796734 time 258905887825 state 0x2 ref 0 00000100:00100000:2.0:1789762956.476827:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762956.476878:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662784 00000100:00100000:3.0:1789762956.476886:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662784 00000100:00100000:3.0:1789762956.476935:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258905796734 time 258905887825 state 0x0 ref 1 00000100:00100000:3.0:1789762956.476950:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258955887825 time 258905887825 state 0x1 ref 1 00000100:00100000:2.0:1789762956.518739:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258955887825 time 258955971429 state 0x0 ref 1 00000100:00100000:2.0:1789762956.518774:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662784:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.518831:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 56623104, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x1b000 00010000:00010000:2.0:1789762956.518838:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.518851:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1789762956.518854:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.518859:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.518871:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.524040:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967695 is committed 00002000:00010000:0.0:1789762956.524107:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:0.0:1789762956.524113:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 110592 -> 112640 00010000:00010000:0.0:1789762956.524122:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.524132:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.524138:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.524143:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.524146:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.524153:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.524167:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.524172:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0390879/0x5915dfb1c1b5b69f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.524246:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246662784:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5493us (47419us total) trans 4294967695 rc 0/0 00000100:00100000:0.0:1789762956.524255:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 268 00000100:00100000:0.0:1789762956.524264:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258955887825 time 258955971429 state 0x2 ref 0 00000100:00100000:1.0:1789762956.526644:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.526692:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246662912 00000100:00100000:0.0:1789762956.526700:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246662912 00000100:00100000:0.0:1789762956.526737:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 258955887825 time 258955971429 state 0x0 ref 1 00000100:00100000:0.0:1789762956.526749:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259005971429 time 258955971429 state 0x1 ref 1 00000100:00100000:2.0:1789762956.568838:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259005971429 time 259006073297 state 0x0 ref 1 00000100:00100000:2.0:1789762956.568856:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662912:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.568897:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 57671680, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x1b800 00010000:00010000:2.0:1789762956.568904:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.568916:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1789762956.568919:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.568924:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.568935:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.574152:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967696 is committed 00002000:00010000:0.0:1789762956.574234:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:0.0:1789762956.574238:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 112640 -> 114688 00010000:00010000:0.0:1789762956.574247:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.574255:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.574261:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.574266:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.574270:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.574286:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.574299:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.574304:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b6a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.574353:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246662912:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5501us (47710us total) trans 4294967696 rc 0/0 00000100:00100000:0.0:1789762956.574361:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 269 00000100:00100000:0.0:1789762956.574369:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259005971429 time 259006073297 state 0x2 ref 0 00000100:00100000:1.0:1789762956.576849:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762956.576903:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663040 00000100:00100000:2.0:1789762956.576911:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663040 00000100:00100000:2.0:1789762956.576946:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259005971429 time 259006073297 state 0x0 ref 1 00000100:00100000:2.0:1789762956.576956:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259056073297 time 259006073297 state 0x1 ref 1 00000100:00100000:0.0:1789762956.618907:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259056073297 time 259056142147 state 0x0 ref 1 00000100:00100000:0.0:1789762956.618926:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246663040:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762956.618976:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 58720256, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x1c000 00010000:00010000:0.0:1789762956.618985:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.619011:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:0.0:1789762956.619015:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.619020:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.619053:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.623743:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967697 is committed 00002000:00010000:0.0:1789762956.623832:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:0.0:1789762956.623837:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 114688 -> 116736 00010000:00010000:0.0:1789762956.623845:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.623853:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.623860:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.623865:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.623868:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.623875:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.623887:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.623892:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfda9be4/0x5915dfb1c1b5b6ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.623950:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246663040:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5028us (47099us total) trans 4294967697 rc 0/0 00000100:00100000:0.0:1789762956.623962:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 270 00000100:00100000:0.0:1789762956.623974:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259056073297 time 259056142147 state 0x2 ref 0 00000100:00100000:2.0:1789762956.626324:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.626361:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663168 00000100:00100000:0.0:1789762956.626369:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663168 00000100:00100000:0.0:1789762956.626405:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259056073297 time 259056142147 state 0x0 ref 1 00000100:00100000:0.0:1789762956.626417:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259106142147 time 259056142147 state 0x1 ref 1 00000100:00100000:1.0:1789762956.669071:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259106142147 time 259106305543 state 0x0 ref 1 00000100:00100000:1.0:1789762956.669093:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246663168:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762956.669137:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 59768832, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x1c800 00010000:00010000:1.0:1789762956.669144:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.669157:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:1.0:1789762956.669161:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762956.669166:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.669176:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.673362:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967698 is committed 00002000:00010000:0.0:1789762956.673459:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:0.0:1789762956.673464:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 116736 -> 118784 00010000:00010000:0.0:1789762956.673472:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.673499:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.673506:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.673511:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.673515:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.673532:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.673546:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.673551:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5b6b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.673614:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246663168:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4528us (47291us total) trans 4294967698 rc 0/0 00000100:00100000:0.0:1789762956.673621:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 271 00000100:00100000:0.0:1789762956.673628:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259106142147 time 259106305543 state 0x2 ref 0 00000100:00100000:1.0:1789762956.675709:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762956.675737:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762956.675778:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762956.675782:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663296 00000100:00100000:0.0:1789762956.675787:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663424 00000100:00100000:0.0:1789762956.675798:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663424 00000100:00100000:3.0:1789762956.675798:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663296 00000100:00100000:1.0:1789762956.675803:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:1.0:1789762956.675839:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762956.675847:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 275 00000100:00100000:3.0:1789762956.675859:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246663296:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762956.675860:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663680 00000100:00100000:2.0:1789762956.675869:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663680 00000100:00100000:0.0:1789762956.675871:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:1.0:1789762956.675871:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663552 00000100:00100000:1.0:1789762956.675887:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663552 00000100:00100000:0.0:1789762956.675894:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246663424:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762956.675926:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:1.0:1789762956.675936:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246663552:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762956.675946:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:2.0:1789762956.675960:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246663680:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762956.675976:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246663296:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762956.675977:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246663424:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762956.675983:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:2355:x1876702246663552:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762956.675997:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 275 00000100:00100000:0.0:1789762956.675998:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:1.0:1789762956.675999:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:2.0:1789762956.676006:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246663680:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762956.676015:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00080000:3.0:1789762956.676069:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762956.676111:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762956.676147:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663808 00000100:00100000:1.0:1789762956.676152:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663808 00000100:00100000:1.0:1789762956.676190:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259106142147 time 259106305543 state 0x0 ref 1 00000100:00100000:1.0:1789762956.676201:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259156305543 time 259106305543 state 0x1 ref 1 00000100:00100000:3.0:1789762956.719167:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259156305543 time 259156387714 state 0x0 ref 1 00000100:00100000:3.0:1789762956.719187:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246663808:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762956.719232:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 60817408, mtime: 0x6aad9d8c, atime: 0x0, ctime: 0x6aad9d8c, blocks: 0x1d000 00010000:00010000:3.0:1789762956.719239:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.719252:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:3.0:1789762956.719256:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.719261:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.719272:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.723671:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967699 is committed 00002000:00010000:3.0:1789762956.723738:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:3.0:1789762956.723743:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 1789762956 -> 1789762957 00002000:00010000:3.0:1789762956.723745:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 1789762956 -> 1789762957 00002000:00010000:3.0:1789762956.723747:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 118784 -> 120832 00010000:00010000:3.0:1789762956.723778:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.723787:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.723793:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.723798:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762956.723802:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.723809:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.723822:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.723827:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.723899:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246663808:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4716us (47785us total) trans 4294967699 rc 0/0 00000100:00100000:3.0:1789762956.723909:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 272 00000100:00100000:3.0:1789762956.723920:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259156305543 time 259156387714 state 0x2 ref 0 00000100:00100000:1.0:1789762956.726788:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762956.726826:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246663936 00000100:00100000:0.0:1789762956.726835:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246663936 00000100:00100000:0.0:1789762956.726879:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259156305543 time 259156387714 state 0x0 ref 1 00000100:00100000:0.0:1789762956.726897:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259206387714 time 259156387714 state 0x1 ref 1 00000100:00100000:2.0:1789762956.769231:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259206387714 time 259206461323 state 0x0 ref 1 00000100:00100000:2.0:1789762956.769250:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246663936:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.769295:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 61865984, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x1d800 00010000:00010000:2.0:1789762956.769301:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.769314:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1789762956.769318:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.769333:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.769345:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.773338:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967700 is committed 00002000:00010000:3.0:1789762956.773404:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:3.0:1789762956.773411:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 120832 -> 122880 00010000:00010000:3.0:1789762956.773421:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.773433:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.773443:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.773452:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762956.773457:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.773467:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.773493:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.773500:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb682e69/0x5915dfb1c1b5b6c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.773554:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246663936:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4309us (46767us total) trans 4294967700 rc 0/0 00000100:00100000:3.0:1789762956.773570:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 273 00000100:00100000:3.0:1789762956.773578:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259206387714 time 259206461323 state 0x2 ref 0 00000100:00100000:0.0:1789762956.775614:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762956.775668:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664064 00000100:00100000:1.0:1789762956.775676:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664064 00000100:00100000:1.0:1789762956.775713:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259206387714 time 259206461323 state 0x0 ref 1 00000100:00100000:1.0:1789762956.775723:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259256461323 time 259206461323 state 0x1 ref 1 00000100:00100000:3.0:1789762956.819308:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259256461323 time 259256543016 state 0x0 ref 1 00000100:00100000:3.0:1789762956.819327:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664064:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762956.819365:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 62914560, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x1e000 00010000:00010000:3.0:1789762956.819371:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.819384:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:3.0:1789762956.819387:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762956.819392:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.819403:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.823194:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967701 is committed 00002000:00010000:3.0:1789762956.823257:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:3.0:1789762956.823263:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 122880 -> 124928 00010000:00010000:3.0:1789762956.823270:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.823278:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.823295:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.823300:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762956.823303:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.823309:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.823321:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762956.823326:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762956.823375:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664064:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4053us (47761us total) trans 4294967701 rc 0/0 00000100:00100000:3.0:1789762956.823381:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 274 00000100:00100000:3.0:1789762956.823387:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259256461323 time 259256543016 state 0x2 ref 0 00000100:00100000:2.0:1789762956.825420:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762956.825466:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664192 00000100:00100000:3.0:1789762956.825488:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664192 00000100:00100000:3.0:1789762956.825531:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259256461323 time 259256543016 state 0x0 ref 1 00000100:00100000:3.0:1789762956.825561:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259306543016 time 259256543016 state 0x1 ref 1 00000100:00100000:2.0:1789762956.869531:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259306543016 time 259306756589 state 0x0 ref 1 00000100:00100000:2.0:1789762956.869581:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246664192:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762956.869646:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 63963136, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x1e800 00010000:00010000:2.0:1789762956.869657:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.869676:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1789762956.869682:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762956.869689:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.869704:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.874428:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967702 is committed 00002000:00010000:2.0:1789762956.874510:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:2.0:1789762956.874515:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 124928 -> 126976 00010000:00010000:2.0:1789762956.874535:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.874554:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.874560:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.874565:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762956.874568:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.874574:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.874587:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.874605:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b6d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762956.874659:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246664192:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5091us (49241us total) trans 4294967702 rc 0/0 00000100:00100000:2.0:1789762956.874666:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 275 00000100:00100000:2.0:1789762956.874674:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259306543016 time 259306756589 state 0x2 ref 0 00000100:00100000:1.0:1789762956.876933:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762956.876974:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664320 00000100:00100000:3.0:1789762956.876983:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664320 00000100:00100000:3.0:1789762956.877017:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259306543016 time 259306756589 state 0x0 ref 1 00000100:00100000:3.0:1789762956.877027:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259356756589 time 259306756589 state 0x1 ref 1 00000100:00100000:1.0:1789762956.919636:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259356756589 time 259356866853 state 0x0 ref 1 00000100:00100000:1.0:1789762956.919669:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664320:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762956.919713:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 65011712, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x1f000 00010000:00010000:1.0:1789762956.919731:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.919745:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:1.0:1789762956.919774:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762956.919782:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762956.919797:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.923882:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967703 is committed 00002000:00010000:2.0:1789762956.923967:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:2.0:1789762956.923981:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 126976 -> 129024 00010000:00010000:2.0:1789762956.924004:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.924015:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.924024:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.924031:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762956.924036:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.924044:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.924073:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762956.924082:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b6d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762956.924132:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664320:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4480us (47200us total) trans 4294967703 rc 0/0 00000100:00100000:2.0:1789762956.924139:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 276 00000100:00100000:2.0:1789762956.924146:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259356756589 time 259356866853 state 0x2 ref 0 00000100:00100000:1.0:1789762956.926319:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762956.926352:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664448 00000100:00100000:3.0:1789762956.926360:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664448 00000100:00100000:3.0:1789762956.926394:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259356756589 time 259356866853 state 0x0 ref 1 00000100:00100000:3.0:1789762956.926404:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259406866853 time 259356866853 state 0x1 ref 1 00000100:00100000:0.0:1789762956.969733:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259406866853 time 259406954845 state 0x0 ref 1 00000100:00100000:0.0:1789762956.969769:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246664448:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762956.969811:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 66060288, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x1f800 00010000:00010000:0.0:1789762956.969818:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.969830:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:0.0:1789762956.969834:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762956.969839:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.969850:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762956.974010:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967704 is committed 00002000:00010000:0.0:1789762956.974094:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:0.0:1789762956.974098:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 129024 -> 131072 00010000:00010000:0.0:1789762956.974106:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.974115:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.974132:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.974137:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762956.974140:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.974146:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.974159:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762956.974165:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6de lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762956.974219:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246664448:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4471us (47901us total) trans 4294967704 rc 0/0 00000100:00100000:0.0:1789762956.974225:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 277 00000100:00100000:0.0:1789762956.974232:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259406866853 time 259406954845 state 0x2 ref 0 00000100:00100000:1.0:1789762956.976493:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762956.976556:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664576 00000100:00100000:2.0:1789762956.976565:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664576 00000100:00100000:2.0:1789762956.976611:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259406866853 time 259406954845 state 0x0 ref 1 00000100:00100000:2.0:1789762956.976622:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259456954845 time 259406954845 state 0x1 ref 1 00000100:00100000:0.0:1789762957.019829:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259456954845 time 259457063759 state 0x0 ref 1 00000100:00100000:0.0:1789762957.019863:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664576:12345-192.168.203.36@tcp:4:dd.0 00000100:00080000:3.0:1789762957.019888:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789762957.019911:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 67108864, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x20000 00010000:00010000:0.0:1789762957.019918:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.019930:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:0.0:1789762957.019933:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.019938:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.019949:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.023868:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967705 is committed 00002000:00010000:1.0:1789762957.023944:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:1.0:1789762957.023950:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 131072 -> 133120 00010000:00010000:1.0:1789762957.023960:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.023976:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.023986:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.023995:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.024000:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.024011:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.024028:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.024037:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b6e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.024100:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664576:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4256us (47606us total) trans 4294967705 rc 0/0 00000100:00100000:1.0:1789762957.024109:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 278 00000100:00100000:1.0:1789762957.024120:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259456954845 time 259457063759 state 0x2 ref 0 00000100:00100000:2.0:1789762957.026272:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.026317:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664704 00000100:00100000:1.0:1789762957.026332:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664704 00000100:00100000:1.0:1789762957.026373:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259456954845 time 259457063759 state 0x0 ref 1 00000100:00100000:1.0:1789762957.026388:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259507063759 time 259457063759 state 0x1 ref 1 00000100:00100000:1.0:1789762957.069913:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259507063759 time 259507142704 state 0x0 ref 1 00000100:00100000:1.0:1789762957.069936:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246664704:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762957.069986:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 68157440, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x20800 00010000:00010000:1.0:1789762957.069995:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.070011:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:1.0:1789762957.070017:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762957.070024:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.070038:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.074209:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967706 is committed 00002000:00010000:1.0:1789762957.074282:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:1.0:1789762957.074288:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 133120 -> 135168 00010000:00010000:1.0:1789762957.074298:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.074308:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.074326:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.074334:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.074338:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.074349:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.074366:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.074376:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b6ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.074448:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246664704:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4516us (48175us total) trans 4294967706 rc 0/0 00000100:00100000:1.0:1789762957.074457:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 279 00000100:00100000:1.0:1789762957.074467:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259507063759 time 259507142704 state 0x2 ref 0 00000100:00100000:0.0:1789762957.076695:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.076741:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664832 00000100:00100000:1.0:1789762957.076769:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664832 00000100:00100000:1.0:1789762957.076809:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259507063759 time 259507142704 state 0x0 ref 1 00000100:00100000:1.0:1789762957.076835:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259557142704 time 259507142704 state 0x1 ref 1 00000100:00100000:3.0:1789762957.120011:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259557142704 time 259557241901 state 0x0 ref 1 00000100:00100000:3.0:1789762957.120034:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246664832:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762957.120078:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 69206016, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x21000 00010000:00010000:3.0:1789762957.120087:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.120101:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:3.0:1789762957.120117:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.120123:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.120138:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.124163:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967707 is committed 00002000:00010000:3.0:1789762957.124236:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:3.0:1789762957.124241:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 135168 -> 137216 00010000:00010000:3.0:1789762957.124249:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.124257:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.124274:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.124278:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.124281:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.124288:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.124300:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.124315:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.124364:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246664832:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4338us (47670us total) trans 4294967707 rc 0/0 00000100:00100000:3.0:1789762957.124371:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 280 00000100:00100000:3.0:1789762957.124377:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259557142704 time 259557241901 state 0x2 ref 0 00000100:00100000:2.0:1789762957.126803:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.126860:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246664960 00000100:00100000:1.0:1789762957.126880:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246664960 00000100:00100000:1.0:1789762957.126922:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259557142704 time 259557241901 state 0x0 ref 1 00000100:00100000:1.0:1789762957.126938:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259607241901 time 259557241901 state 0x1 ref 1 00000100:00100000:3.0:1789762957.170089:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259607241901 time 259607324167 state 0x0 ref 1 00000100:00100000:3.0:1789762957.170107:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664960:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762957.170145:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 70254592, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x21800 00010000:00010000:3.0:1789762957.170151:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.170164:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:3.0:1789762957.170167:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.170172:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.170182:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.174169:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967708 is committed 00002000:00010000:3.0:1789762957.174224:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:3.0:1789762957.174234:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 137216 -> 139264 00010000:00010000:3.0:1789762957.174244:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.174252:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.174258:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.174263:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.174266:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.174272:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.174285:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.174290:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b6fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.174336:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246664960:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4234us (47534us total) trans 4294967708 rc 0/0 00000100:00100000:3.0:1789762957.174343:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 281 00000100:00100000:3.0:1789762957.174350:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259607241901 time 259607324167 state 0x2 ref 0 00000100:00100000:2.0:1789762957.176470:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.176544:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665088 00000100:00100000:1.0:1789762957.176552:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665088 00000100:00100000:1.0:1789762957.176591:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259607241901 time 259607324167 state 0x0 ref 1 00000100:00100000:1.0:1789762957.176605:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259657324167 time 259607324167 state 0x1 ref 1 00010000:00010000:3.0:1789762957.178868:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762957.220186:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259657324167 time 259657418616 state 0x0 ref 1 00000100:00100000:2.0:1789762957.220207:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246665088:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762957.220259:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 71303168, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x22000 00010000:00010000:2.0:1789762957.220267:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.220279:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1789762957.220282:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.220288:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.220298:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.224643:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967709 is committed 00002000:00010000:3.0:1789762957.224713:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:3.0:1789762957.224718:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 139264 -> 141312 00010000:00010000:3.0:1789762957.224727:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.224735:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.224742:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.224746:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.224765:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.224773:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.224786:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.224791:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002566969e/0x5915dfb1c1b5b701 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.224844:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246665088:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4642us (48376us total) trans 4294967709 rc 0/0 00000100:00100000:3.0:1789762957.224858:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 282 00000100:00100000:3.0:1789762957.224866:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259657324167 time 259657418616 state 0x2 ref 0 00000100:00100000:2.0:1789762957.227154:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762957.227219:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665216 00000100:00100000:0.0:1789762957.227227:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665216 00000100:00100000:0.0:1789762957.227266:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259657324167 time 259657418616 state 0x0 ref 1 00000100:00100000:0.0:1789762957.227277:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259707418616 time 259657418616 state 0x1 ref 1 00000100:00100000:2.0:1789762957.270306:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259707418616 time 259707537360 state 0x0 ref 1 00000100:00100000:2.0:1789762957.270331:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246665216:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762957.270372:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 72351744, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x22800 00010000:00010000:2.0:1789762957.270380:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.270401:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1789762957.270405:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.270410:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.270420:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.274673:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967710 is committed 00002000:00010000:1.0:1789762957.274744:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:1.0:1789762957.274765:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 141312 -> 143360 00010000:00010000:1.0:1789762957.274776:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.274786:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.274795:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.274810:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.274815:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.274826:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.274844:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.274852:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8a0e9e4/0x5915dfb1c1b5b708 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.274911:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246665216:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4587us (47757us total) trans 4294967710 rc 0/0 00000100:00100000:1.0:1789762957.274920:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 283 00000100:00100000:1.0:1789762957.274931:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259707418616 time 259707537360 state 0x2 ref 0 00000100:00100000:0.0:1789762957.277169:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762957.277208:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665344 00000100:00100000:3.0:1789762957.277216:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665344 00000100:00100000:3.0:1789762957.277250:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259707418616 time 259707537360 state 0x0 ref 1 00000100:00100000:3.0:1789762957.277260:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259757537360 time 259707537360 state 0x1 ref 1 00000100:00100000:0.0:1789762957.320416:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259757537360 time 259757648728 state 0x0 ref 1 00000100:00100000:0.0:1789762957.320436:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246665344:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762957.320492:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 73400320, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x23000 00010000:00010000:0.0:1789762957.320500:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.320523:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:0.0:1789762957.320527:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.320531:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.320542:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.324528:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967711 is committed 00002000:00010000:1.0:1789762957.324585:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:1.0:1789762957.324590:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 143360 -> 145408 00010000:00010000:1.0:1789762957.324598:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.324608:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.324624:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.324629:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.324633:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.324639:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.324652:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.324658:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac8fbc9/0x5915dfb1c1b5b70f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.324712:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246665344:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4280us (47544us total) trans 4294967711 rc 0/0 00000100:00100000:1.0:1789762957.324719:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 284 00000100:00100000:1.0:1789762957.324727:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259757537360 time 259757648728 state 0x2 ref 0 00000100:00100000:2.0:1789762957.327036:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762957.327076:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665472 00000100:00100000:3.0:1789762957.327085:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665472 00000100:00100000:3.0:1789762957.327121:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259757537360 time 259757648728 state 0x0 ref 1 00000100:00100000:3.0:1789762957.327133:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259807648728 time 259757648728 state 0x1 ref 1 00000100:00100000:1.0:1789762957.370517:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259807648728 time 259807752679 state 0x0 ref 1 00000100:00100000:1.0:1789762957.370536:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246665472:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762957.370590:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 74448896, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x23800 00010000:00010000:1.0:1789762957.370598:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.370611:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:1.0:1789762957.370615:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762957.370619:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.370630:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.374839:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967712 is committed 00002000:00010000:1.0:1789762957.374897:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:1.0:1789762957.374903:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 145408 -> 147456 00010000:00010000:1.0:1789762957.374912:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.374923:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.374934:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.374942:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.374947:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.374974:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.374988:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.374997:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b716 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.375054:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246665472:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4522us (48020us total) trans 4294967712 rc 0/0 00000100:00100000:1.0:1789762957.375061:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 285 00000100:00100000:1.0:1789762957.375069:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259807648728 time 259807752679 state 0x2 ref 0 00000100:00100000:0.0:1789762957.377516:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.377552:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665600 00000100:00100000:1.0:1789762957.377559:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665600 00000100:00100000:1.0:1789762957.377591:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259807648728 time 259807752679 state 0x0 ref 1 00000100:00100000:1.0:1789762957.377601:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259857752679 time 259807752679 state 0x1 ref 1 00000100:00100000:1.0:1789762957.420624:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259857752679 time 259857857313 state 0x0 ref 1 00000100:00100000:1.0:1789762957.420645:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246665600:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762957.420689:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 75497472, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x24000 00010000:00010000:1.0:1789762957.420707:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.420720:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:1.0:1789762957.420724:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762957.420728:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.420739:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.424723:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967713 is committed 00002000:00010000:1.0:1789762957.424780:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:1.0:1789762957.424785:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 147456 -> 149504 00010000:00010000:1.0:1789762957.424793:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.424802:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.424808:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.424813:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.424817:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.424824:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.424845:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.424851:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b71d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.424899:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246665600:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4260us (47384us total) trans 4294967713 rc 0/0 00000100:00100000:1.0:1789762957.424906:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 286 00000100:00100000:1.0:1789762957.424914:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259857752679 time 259857857313 state 0x2 ref 0 00000100:00100000:2.0:1789762957.427276:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.427343:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665728 00000100:00100000:1.0:1789762957.427351:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665728 00000100:00100000:1.0:1789762957.427386:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259857752679 time 259857857313 state 0x0 ref 1 00000100:00100000:1.0:1789762957.427398:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259907857313 time 259857857313 state 0x1 ref 1 00000100:00100000:0.0:1789762957.470700:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259907857313 time 259907934282 state 0x0 ref 1 00000100:00100000:0.0:1789762957.470718:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246665728:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762957.470779:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 76546048, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x24800 00010000:00010000:0.0:1789762957.470786:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.470798:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:0.0:1789762957.470802:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.470806:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.470817:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.475211:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967714 is committed 00002000:00010000:3.0:1789762957.475303:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:3.0:1789762957.475308:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 149504 -> 151552 00010000:00010000:3.0:1789762957.475316:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.475325:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.475341:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.475346:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767ca00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.475349:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.475355:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.475369:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.475374:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004de12fa4/0x5915dfb1c1b5b724 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.475424:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246665728:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4710us (48148us total) trans 4294967714 rc 0/0 00000100:00100000:3.0:1789762957.475430:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 287 00000100:00100000:3.0:1789762957.475437:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259907857313 time 259907934282 state 0x2 ref 0 00000100:00100000:2.0:1789762957.477709:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.477787:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665856 00000100:00100000:1.0:1789762957.477795:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665856 00000100:00100000:1.0:1789762957.477826:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259907857313 time 259907934282 state 0x0 ref 1 00000100:00100000:1.0:1789762957.477836:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259957934282 time 259907934282 state 0x1 ref 1 00000100:00100000:3.0:1789762957.520802:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259957934282 time 259958038068 state 0x0 ref 1 00000100:00100000:3.0:1789762957.520819:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246665856:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762957.520863:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 77594624, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x25000 00010000:00010000:3.0:1789762957.520870:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.520882:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=259s v=(0 0) 00010000:00010000:3.0:1789762957.520885:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.520889:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.520899:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.525012:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967715 is committed 00002000:00010000:3.0:1789762957.525109:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:3.0:1789762957.525113:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 151552 -> 153600 00010000:00010000:3.0:1789762957.525121:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.525129:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.525135:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.525140:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.525143:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.525160:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.525172:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.525177:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b72b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.525226:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246665856:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4410us (47517us total) trans 4294967715 rc 0/0 00000100:00100000:3.0:1789762957.525232:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 288 00000100:00100000:3.0:1789762957.525239:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259957934282 time 259958038068 state 0x2 ref 0 00000100:00100000:2.0:1789762957.527620:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.527665:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246665984 00000100:00100000:1.0:1789762957.527672:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246665984 00000100:00100000:1.0:1789762957.527709:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 259957934282 time 259958038068 state 0x0 ref 1 00000100:00100000:1.0:1789762957.527719:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260008038068 time 259958038068 state 0x1 ref 1 00000100:00100000:3.0:1789762957.570892:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260008038068 time 260008118484 state 0x0 ref 1 00000100:00100000:3.0:1789762957.570913:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246665984:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762957.570958:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 78643200, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x25800 00010000:00010000:3.0:1789762957.570965:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.570978:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:3.0:1789762957.570982:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.570986:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.571010:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.575113:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967716 is committed 00002000:00010000:3.0:1789762957.575201:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789762957.575206:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 153600 -> 155648 00010000:00010000:3.0:1789762957.575214:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.575223:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.575230:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.575237:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.575241:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.575251:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.575268:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.575278:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b732 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.575341:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246665984:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4434us (47721us total) trans 4294967716 rc 0/0 00000100:00100000:3.0:1789762957.575348:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 289 00000100:00100000:3.0:1789762957.575356:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260008038068 time 260008118484 state 0x2 ref 0 00000100:00100000:2.0:1789762957.577442:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762957.577483:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246666112 00000100:00100000:3.0:1789762957.577490:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246666112 00000100:00100000:3.0:1789762957.577522:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260008038068 time 260008118484 state 0x0 ref 1 00000100:00100000:3.0:1789762957.577532:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260058118484 time 260008118484 state 0x1 ref 1 00000100:00100000:2.0:1789762957.620991:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260058118484 time 260058226621 state 0x0 ref 1 00000100:00100000:2.0:1789762957.621008:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246666112:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762957.621041:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 79691776, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x26000 00010000:00010000:2.0:1789762957.621048:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.621068:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:2.0:1789762957.621072:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.621076:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.621086:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.624893:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967717 is committed 00002000:00010000:1.0:1789762957.624997:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:1.0:1789762957.625002:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 155648 -> 157696 00010000:00010000:1.0:1789762957.625009:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.625018:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.625025:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.625029:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.625032:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.625039:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.625051:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.625066:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000479acb0b/0x5915dfb1c1b5b739 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.625120:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246666112:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4114us (47677us total) trans 4294967717 rc 0/0 00000100:00100000:1.0:1789762957.625130:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 290 00000100:00100000:1.0:1789762957.625140:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260058118484 time 260058226621 state 0x2 ref 0 00000100:00100000:0.0:1789762957.627161:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762957.627203:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246666240 00000100:00100000:3.0:1789762957.627210:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246666240 00000100:00100000:3.0:1789762957.627250:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260058118484 time 260058226621 state 0x0 ref 1 00000100:00100000:3.0:1789762957.627265:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260108226621 time 260058226621 state 0x1 ref 1 00000100:00100000:0.0:1789762957.671080:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260108226621 time 260108311481 state 0x0 ref 1 00000100:00100000:0.0:1789762957.671101:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246666240:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762957.671156:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 80740352, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x26800 00010000:00010000:0.0:1789762957.671163:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.671176:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1789762957.671180:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.671185:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.671202:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.675228:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967718 is committed 00002000:00010000:0.0:1789762957.675324:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:0.0:1789762957.675329:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 157696 -> 159744 00010000:00010000:0.0:1789762957.675338:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.675346:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.675353:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.675368:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762957.675371:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.675377:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.675390:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.675395:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b740 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762957.675451:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246666240:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4356us (48292us total) trans 4294967718 rc 0/0 00000100:00100000:0.0:1789762957.675457:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 291 00000100:00100000:0.0:1789762957.675465:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260108226621 time 260108311481 state 0x2 ref 0 00000100:00100000:1.0:1789762957.677701:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762957.677741:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246666368 00000100:00100000:3.0:1789762957.677774:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246666368 00000100:00100000:3.0:1789762957.677811:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260108226621 time 260108311481 state 0x0 ref 1 00000100:00100000:3.0:1789762957.677821:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260158311481 time 260108311481 state 0x1 ref 1 00000100:00100000:1.0:1789762957.721148:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260158311481 time 260158381877 state 0x0 ref 1 00000100:00100000:1.0:1789762957.721167:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246666368:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762957.721205:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 81788928, mtime: 0x6aad9d8d, atime: 0x0, ctime: 0x6aad9d8d, blocks: 0x27000 00010000:00010000:1.0:1789762957.721213:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.721225:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:1.0:1789762957.721228:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762957.721232:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.721243:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.725099:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967719 is committed 00002000:00010000:1.0:1789762957.725154:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:1.0:1789762957.725159:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 1789762957 -> 1789762958 00002000:00010000:1.0:1789762957.725161:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 1789762957 -> 1789762958 00002000:00010000:1.0:1789762957.725164:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 159744 -> 161792 00010000:00010000:1.0:1789762957.725171:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.725180:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.725186:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.725191:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.725194:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.725200:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.725213:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.725218:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b747 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.725279:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246666368:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4116us (47578us total) trans 4294967719 rc 0/0 00000100:00100000:1.0:1789762957.725285:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 292 00000100:00100000:1.0:1789762957.725292:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260158311481 time 260158381877 state 0x2 ref 0 00000100:00100000:2.0:1789762957.727494:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.727540:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246666496 00000100:00100000:1.0:1789762957.727550:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246666496 00000100:00100000:1.0:1789762957.727593:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260158311481 time 260158381877 state 0x0 ref 1 00000100:00100000:1.0:1789762957.727608:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260208381877 time 260158381877 state 0x1 ref 1 00000100:00100000:1.0:1789762957.771207:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260208381877 time 260208441099 state 0x0 ref 1 00000100:00100000:1.0:1789762957.771228:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246666496:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762957.771271:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 82837504, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x27800 00010000:00010000:1.0:1789762957.771278:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.771291:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:1.0:1789762957.771294:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762957.771299:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.771310:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.775345:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967720 is committed 00002000:00010000:1.0:1789762957.775427:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:1.0:1789762957.775432:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 161792 -> 163840 00010000:00010000:1.0:1789762957.775440:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.775449:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.775455:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.775460:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.775463:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.775484:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.775500:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.775506:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b74e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.775557:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246666496:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4334us (48066us total) trans 4294967720 rc 0/0 00000100:00100000:1.0:1789762957.775571:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 293 00000100:00100000:1.0:1789762957.775579:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260208381877 time 260208441099 state 0x2 ref 0 00000100:00100000:2.0:1789762957.777797:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762957.777823:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246666624 00000100:00100000:0.0:1789762957.777831:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246666624 00000100:00100000:0.0:1789762957.777867:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260208381877 time 260208441099 state 0x0 ref 1 00000100:00100000:0.0:1789762957.777877:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260258441099 time 260208441099 state 0x1 ref 1 00000100:00100000:0.0:1789762957.821273:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260258441099 time 260258499318 state 0x0 ref 1 00000100:00100000:0.0:1789762957.821304:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246666624:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762957.821349:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 83886080, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x28000 00010000:00010000:0.0:1789762957.821356:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.821369:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1789762957.821373:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762957.821378:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762957.821388:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.825563:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967721 is committed 00002000:00010000:3.0:1789762957.825617:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:3.0:1789762957.825622:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 163840 -> 165888 00010000:00010000:3.0:1789762957.825630:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.825639:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.825645:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.825650:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767cc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.825654:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.825660:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.825673:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.825678:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b44a01ab/0x5915dfb1c1b5b755 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.825738:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246666624:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4439us (47944us total) trans 4294967721 rc 0/0 00000100:00100000:3.0:1789762957.825746:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 294 00000100:00100000:3.0:1789762957.825779:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260258441099 time 260258499318 state 0x2 ref 0 00000100:00100000:2.0:1789762957.828136:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.828181:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246666752 00000100:00100000:1.0:1789762957.828189:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246666752 00000100:00100000:1.0:1789762957.828224:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260258441099 time 260258499318 state 0x0 ref 1 00000100:00100000:1.0:1789762957.828236:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260308499318 time 260258499318 state 0x1 ref 1 00000100:00100000:3.0:1789762957.871340:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260308499318 time 260308575167 state 0x0 ref 1 00000100:00100000:3.0:1789762957.871358:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246666752:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762957.871403:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 84934656, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x28800 00010000:00010000:3.0:1789762957.871414:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.871431:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:3.0:1789762957.871436:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.871443:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.871457:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.875645:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967722 is committed 00002000:00010000:3.0:1789762957.875701:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789762957.875706:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 165888 -> 167936 00010000:00010000:3.0:1789762957.875714:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.875732:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.875738:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.875743:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.875746:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.875769:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.875782:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.875787:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b75c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.875835:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246666752:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4482us (47701us total) trans 4294967722 rc 0/0 00000100:00100000:3.0:1789762957.875842:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 295 00000100:00100000:3.0:1789762957.875849:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260308499318 time 260308575167 state 0x2 ref 0 00000100:00100000:2.0:1789762957.877848:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762957.877895:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246666880 00000100:00100000:1.0:1789762957.877902:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246666880 00000100:00100000:1.0:1789762957.877941:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260308499318 time 260308575167 state 0x0 ref 1 00000100:00100000:1.0:1789762957.877952:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260358575167 time 260308575167 state 0x1 ref 1 00000100:00100000:3.0:1789762957.921401:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260358575167 time 260358638218 state 0x0 ref 1 00000100:00100000:3.0:1789762957.921425:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246666880:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762957.921456:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 85983232, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x29000 00010000:00010000:3.0:1789762957.921463:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.921489:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:3.0:1789762957.921492:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762957.921497:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.921508:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762957.925435:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967723 is committed 00002000:00010000:3.0:1789762957.925504:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789762957.925508:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 167936 -> 169984 00010000:00010000:3.0:1789762957.925515:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.925523:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.925529:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.925533:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762957.925542:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.925548:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.925560:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762957.925564:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b763 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762957.925607:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246666880:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4186us (47760us total) trans 4294967723 rc 0/0 00000100:00100000:3.0:1789762957.925614:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 296 00000100:00100000:3.0:1789762957.925622:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260358575167 time 260358638218 state 0x2 ref 0 00000100:00100000:1.0:1789762957.927652:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762957.927692:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667008 00000100:00100000:3.0:1789762957.927701:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667008 00000100:00100000:3.0:1789762957.927741:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260358575167 time 260358638218 state 0x0 ref 1 00000100:00100000:3.0:1789762957.927778:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260408638218 time 260358638218 state 0x1 ref 1 00000100:00100000:2.0:1789762957.971526:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260408638218 time 260408758577 state 0x0 ref 1 00000100:00100000:2.0:1789762957.971548:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667008:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762957.971585:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 87031808, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x29800 00010000:00010000:2.0:1789762957.971593:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.971605:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:2.0:1789762957.971609:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762957.971613:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762957.971623:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762957.975652:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967724 is committed 00002000:00010000:1.0:1789762957.975745:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:1.0:1789762957.975766:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 169984 -> 172032 00010000:00010000:1.0:1789762957.975775:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.975784:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.975801:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.975806:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762957.975810:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.975816:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.975828:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762957.975834:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d90208/0x5915dfb1c1b5b76a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762957.975885:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667008:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4342us (48233us total) trans 4294967724 rc 0/0 00000100:00100000:1.0:1789762957.975892:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 297 00000100:00100000:1.0:1789762957.975899:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260408638218 time 260408758577 state 0x2 ref 0 00000100:00100000:0.0:1789762957.977863:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762957.977901:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667136 00000100:00100000:3.0:1789762957.977907:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667136 00000100:00100000:3.0:1789762957.977937:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260408638218 time 260408758577 state 0x0 ref 1 00000100:00100000:3.0:1789762957.977952:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260458758577 time 260408758577 state 0x1 ref 1 00000100:00100000:0.0:1789762958.021626:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260458758577 time 260458862562 state 0x0 ref 1 00000100:00100000:0.0:1789762958.021645:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667136:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762958.021680:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 88080384, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2a000 00010000:00010000:0.0:1789762958.021687:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.021697:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1789762958.021701:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.021705:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.021725:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762958.025532:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967725 is committed 00002000:00010000:1.0:1789762958.025603:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:1.0:1789762958.025608:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 172032 -> 174080 00010000:00010000:1.0:1789762958.025616:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.025634:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.025640:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.025645:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762958.025648:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.025655:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.025666:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.025671:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd502df6/0x5915dfb1c1b5b771 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762958.025722:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667136:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4082us (47859us total) trans 4294967725 rc 0/0 00000100:00100000:1.0:1789762958.025729:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 298 00000100:00100000:1.0:1789762958.025737:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260458758577 time 260458862562 state 0x2 ref 0 00000100:00100000:2.0:1789762958.028718:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.028780:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667264 00000100:00100000:3.0:1789762958.028789:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667264 00000100:00100000:3.0:1789762958.028837:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260458758577 time 260458862562 state 0x0 ref 1 00000100:00100000:3.0:1789762958.028849:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260508862562 time 260458862562 state 0x1 ref 1 00000100:00100000:1.0:1789762958.071707:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260508862562 time 260508939774 state 0x0 ref 1 00000100:00100000:1.0:1789762958.071739:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667264:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762958.071808:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 89128960, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2a800 00010000:00010000:1.0:1789762958.071816:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.071829:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:1.0:1789762958.071832:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762958.071837:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.071849:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762958.075785:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967726 is committed 00002000:00010000:1.0:1789762958.075841:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:1.0:1789762958.075847:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 174080 -> 176128 00010000:00010000:1.0:1789762958.075855:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.075863:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.075870:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.075875:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762958.075887:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.075897:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.075915:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.075924:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b778 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762958.075976:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667264:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4242us (47263us total) trans 4294967726 rc 0/0 00000100:00100000:1.0:1789762958.075983:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 299 00000100:00100000:1.0:1789762958.075990:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260508862562 time 260508939774 state 0x2 ref 0 00000100:00100000:2.0:1789762958.078052:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762958.078089:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667392 00000100:00100000:1.0:1789762958.078098:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667392 00000100:00100000:1.0:1789762958.078132:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260508862562 time 260508939774 state 0x0 ref 1 00000100:00100000:1.0:1789762958.078142:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260558939774 time 260508939774 state 0x1 ref 1 00000100:00100000:1.0:1789762958.121782:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260558939774 time 260558995683 state 0x0 ref 1 00000100:00100000:1.0:1789762958.121802:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667392:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762958.121856:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 90177536, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2b000 00010000:00010000:1.0:1789762958.121863:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.121875:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:1.0:1789762958.121879:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762958.121886:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.121901:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762958.126270:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967727 is committed 00002000:00010000:1.0:1789762958.126325:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:1.0:1789762958.126330:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 176128 -> 178176 00010000:00010000:1.0:1789762958.126338:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.126347:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.126353:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.126358:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762958.126362:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.126395:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.126412:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.126420:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ef75d7/0x5915dfb1c1b5b77f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762958.126516:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667392:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4718us (48463us total) trans 4294967727 rc 0/0 00000100:00100000:1.0:1789762958.126526:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 300 00000100:00100000:1.0:1789762958.126537:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260558939774 time 260558995683 state 0x2 ref 0 00000100:00100000:0.0:1789762958.128987:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762958.129028:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667520 00000100:00100000:1.0:1789762958.129037:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667520 00000100:00100000:1.0:1789762958.129078:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260558939774 time 260558995683 state 0x0 ref 1 00000100:00100000:1.0:1789762958.129107:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260608995683 time 260558995683 state 0x1 ref 1 00000100:00100000:3.0:1789762958.138898:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1789762958.138909:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 260576156054ns, next at 261576152877ns, rc = 0 00000100:00100000:3.0:1789762958.138921:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254934656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762958.138972:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762958.139019:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254934656 00000100:00100000:0.0:1789762958.139027:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254934656 00000100:00080000:3.0:1789762958.139073:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762958.139084:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789762958.139096:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254934656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762958.139114:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3857608704 avail 3591745536 00000100:00100000:0.0:1789762958.139156:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254934656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762958.139162:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789762958.139199:0:3417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967686 gen 2 00000004:00080000:3.0:1789762958.139205:0:3417:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c2161c00, transno 4294967686 00000100:00100000:3.0:1789762958.139223:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254934656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789762958.171900:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260608995683 time 260609138049 state 0x0 ref 1 00000100:00100000:0.0:1789762958.171915:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667520:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762958.171957:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 91226112, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2b800 00010000:00010000:0.0:1789762958.171964:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.171976:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1789762958.171979:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.171983:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.172008:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.175867:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967728 is committed 00002000:00010000:3.0:1789762958.175912:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:3.0:1789762958.175917:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 178176 -> 180224 00010000:00010000:3.0:1789762958.175925:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.175933:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.175950:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.175955:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767c600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.175958:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.175964:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.175976:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.175982:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ba935ea/0x5915dfb1c1b5b786 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.176027:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667520:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4115us (47043us total) trans 4294967728 rc 0/0 00000100:00100000:3.0:1789762958.176034:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 301 00000100:00100000:3.0:1789762958.176041:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260608995683 time 260609138049 state 0x2 ref 0 00000100:00100000:0.0:1789762958.178015:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762958.178062:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667648 00000100:00100000:1.0:1789762958.178069:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667648 00000100:00100000:1.0:1789762958.178102:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260608995683 time 260609138049 state 0x0 ref 1 00000100:00100000:1.0:1789762958.178121:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260659138049 time 260609138049 state 0x1 ref 1 00010000:00010000:1.0:1789762958.202834:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762958.221992:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260659138049 time 260659227763 state 0x0 ref 1 00000100:00100000:3.0:1789762958.222009:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667648:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762958.222051:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 92274688, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2c000 00010000:00010000:3.0:1789762958.222057:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.222068:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:3.0:1789762958.222072:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.222076:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.222085:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.226004:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967729 is committed 00002000:00010000:3.0:1789762958.226058:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:3.0:1789762958.226064:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 180224 -> 182272 00010000:00010000:3.0:1789762958.226074:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.226087:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.226095:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.226103:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.226108:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.226134:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.226149:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.226155:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b78d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.226210:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667648:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4204us (48193us total) trans 4294967729 rc 0/0 00000100:00100000:3.0:1789762958.226219:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 302 00000100:00100000:3.0:1789762958.226229:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260659138049 time 260659227763 state 0x2 ref 0 00000100:00100000:2.0:1789762958.228292:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762958.228335:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667776 00000100:00100000:1.0:1789762958.228342:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667776 00000100:00100000:1.0:1789762958.228377:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260659138049 time 260659227763 state 0x0 ref 1 00000100:00100000:1.0:1789762958.228387:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260709227763 time 260659227763 state 0x1 ref 1 00000100:00100000:3.0:1789762958.272099:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260709227763 time 260709330396 state 0x0 ref 1 00000100:00100000:3.0:1789762958.272125:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667776:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762958.272177:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 93323264, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2c800 00010000:00010000:3.0:1789762958.272193:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.272206:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:3.0:1789762958.272209:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.272214:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.272237:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.276700:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967730 is committed 00002000:00010000:3.0:1789762958.276769:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:3.0:1789762958.276773:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 182272 -> 184320 00010000:00010000:3.0:1789762958.276782:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.276790:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.276797:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.276801:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.276805:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.276811:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.276824:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.276829:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b794 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.276884:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246667776:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4768us (48593us total) trans 4294967730 rc 0/0 00000100:00100000:3.0:1789762958.276891:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 303 00000100:00100000:3.0:1789762958.276899:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260709227763 time 260709330396 state 0x2 ref 0 00000100:00100000:1.0:1789762958.279157:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.279192:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246667904 00000100:00100000:3.0:1789762958.279201:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246667904 00000100:00100000:3.0:1789762958.279235:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260709227763 time 260709330396 state 0x0 ref 1 00000100:00100000:3.0:1789762958.279245:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260759330396 time 260709330396 state 0x1 ref 1 00000100:00100000:2.0:1789762958.322200:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260759330396 time 260759436140 state 0x0 ref 1 00000100:00100000:2.0:1789762958.322217:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667904:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762958.322255:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 94371840, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2d000 00010000:00010000:2.0:1789762958.322262:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.322273:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:2.0:1789762958.322277:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.322281:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.322291:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.326532:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967731 is committed 00002000:00010000:3.0:1789762958.326586:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:3.0:1789762958.326591:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 184320 -> 186368 00010000:00010000:3.0:1789762958.326599:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.326608:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.326614:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.326619:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd22a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.326622:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.326639:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.326652:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.326657:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9403aa7/0x5915dfb1c1b5b79b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.326705:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246667904:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4492us (47548us total) trans 4294967731 rc 0/0 00000100:00100000:3.0:1789762958.326712:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 304 00000100:00100000:3.0:1789762958.326720:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260759330396 time 260759436140 state 0x2 ref 0 00000100:00100000:2.0:1789762958.328954:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.328989:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668032 00000100:00100000:3.0:1789762958.328997:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668032 00000100:00100000:3.0:1789762958.329030:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260759330396 time 260759436140 state 0x0 ref 1 00000100:00100000:3.0:1789762958.329041:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260809436140 time 260759436140 state 0x1 ref 1 00000100:00100000:0.0:1789762958.372286:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260809436140 time 260809520974 state 0x0 ref 1 00000100:00100000:0.0:1789762958.372317:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668032:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762958.372355:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 95420416, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2d800 00010000:00010000:0.0:1789762958.372362:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.372374:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1789762958.372377:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.372382:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.372392:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.376815:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967732 is committed 00002000:00010000:2.0:1789762958.376913:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:2.0:1789762958.376919:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 186368 -> 188416 00010000:00010000:2.0:1789762958.376927:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.376946:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.376952:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.376957:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762958.376960:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.376967:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.376980:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.376985:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e816fbe8/0x5915dfb1c1b5b7a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762958.377037:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668032:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4726us (48085us total) trans 4294967732 rc 0/0 00000100:00100000:2.0:1789762958.377045:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 305 00000100:00100000:2.0:1789762958.377052:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260809436140 time 260809520974 state 0x2 ref 0 00000100:00100000:1.0:1789762958.379394:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.379434:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668160 00000100:00100000:3.0:1789762958.379442:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668160 00000100:00100000:3.0:1789762958.379487:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260809436140 time 260809520974 state 0x0 ref 1 00000100:00100000:3.0:1789762958.379498:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260859520974 time 260809520974 state 0x1 ref 1 00000100:00100000:1.0:1789762958.422394:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260859520974 time 260859630380 state 0x0 ref 1 00000100:00100000:1.0:1789762958.422411:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668160:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762958.422445:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 96468992, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2e000 00010000:00010000:1.0:1789762958.422451:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.422461:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:1.0:1789762958.422477:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762958.422482:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.422501:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.426787:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967733 is committed 00002000:00010000:2.0:1789762958.426871:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:2.0:1789762958.426883:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 188416 -> 190464 00010000:00010000:2.0:1789762958.426894:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.426908:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.426919:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.426927:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762958.426932:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.426941:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.426960:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.426969:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005445cf41/0x5915dfb1c1b5b7a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762958.427039:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668160:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4630us (47643us total) trans 4294967733 rc 0/0 00000100:00100000:2.0:1789762958.427050:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 306 00000100:00100000:2.0:1789762958.427062:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260859520974 time 260859630380 state 0x2 ref 0 00000100:00100000:0.0:1789762958.429509:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.429563:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668288 00000100:00100000:3.0:1789762958.429571:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668288 00000100:00100000:3.0:1789762958.429611:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260859520974 time 260859630380 state 0x0 ref 1 00000100:00100000:3.0:1789762958.429622:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260909630380 time 260859630380 state 0x1 ref 1 00000100:00100000:1.0:1789762958.472531:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260909630380 time 260909766356 state 0x0 ref 1 00000100:00100000:1.0:1789762958.472549:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668288:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:1.0:1789762958.472587:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 97517568, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2e800 00010000:00010000:1.0:1789762958.472594:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.472606:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:1.0:1789762958.472610:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762958.472614:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.472625:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762958.476864:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967734 is committed 00002000:00010000:1.0:1789762958.476969:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:1.0:1789762958.476974:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 190464 -> 192512 00010000:00010000:1.0:1789762958.476982:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.477001:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.477007:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.477012:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762958.477015:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.477022:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.477034:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.477039:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b7b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762958.477089:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffcd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668288:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4545us (47583us total) trans 4294967734 rc 0/0 00000100:00100000:1.0:1789762958.477096:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 307 00000100:00100000:1.0:1789762958.477103:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260909630380 time 260909766356 state 0x2 ref 0 00000100:00100000:0.0:1789762958.479512:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762958.479596:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668416 00000100:00100000:2.0:1789762958.479604:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668416 00000100:00100000:2.0:1789762958.479636:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260909630380 time 260909766356 state 0x0 ref 1 00000100:00100000:2.0:1789762958.479646:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260959766356 time 260909766356 state 0x1 ref 1 00000100:00100000:0.0:1789762958.522595:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260959766356 time 260959830674 state 0x0 ref 1 00000100:00100000:0.0:1789762958.522613:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668416:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:0.0:1789762958.522656:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 98566144, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2f000 00010000:00010000:0.0:1789762958.522663:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.522673:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1789762958.522676:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762958.522681:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.522691:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.526886:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967735 is committed 00002000:00010000:3.0:1789762958.526978:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:3.0:1789762958.526983:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 192512 -> 194560 00010000:00010000:3.0:1789762958.526991:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.526999:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.527008:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.527017:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767de00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.527022:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.527032:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.527048:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.527059:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a53651/0x5915dfb1c1b5b7b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.527120:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668416:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4509us (47608us total) trans 4294967735 rc 0/0 00000100:00100000:3.0:1789762958.527129:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 308 00000100:00100000:3.0:1789762958.527140:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260959766356 time 260959830674 state 0x2 ref 0 00000100:00100000:0.0:1789762958.529616:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762958.529661:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668544 00000100:00100000:2.0:1789762958.529670:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668544 00000100:00100000:2.0:1789762958.529705:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 260959766356 time 260959830674 state 0x0 ref 1 00000100:00100000:2.0:1789762958.529715:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261009830674 time 260959830674 state 0x1 ref 1 00000100:00100000:2.0:1789762958.572671:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261009830674 time 261009903906 state 0x0 ref 1 00000100:00100000:2.0:1789762958.572692:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668544:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762958.572748:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 99614720, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x2f800 00010000:00010000:2.0:1789762958.572773:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.572787:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=261s v=(0 0) 00010000:00010000:2.0:1789762958.572791:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.572795:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.572808:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.578118:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967736 is committed 00002000:00010000:3.0:1789762958.578196:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:3.0:1789762958.578201:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 194560 -> 196608 00010000:00010000:3.0:1789762958.578212:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.578222:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.578229:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.578234:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.578237:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.578244:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.578271:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.578277:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051af088e/0x5915dfb1c1b5b7be lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.578339:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668544:12345-192.168.203.36@tcp:4:dd.0 Request processed in 5652us (48722us total) trans 4294967736 rc 0/0 00000100:00100000:3.0:1789762958.578347:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 309 00000100:00100000:3.0:1789762958.578356:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261009830674 time 261009903906 state 0x2 ref 0 00000100:00100000:0.0:1789762958.580919:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762958.580988:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668672 00000100:00100000:1.0:1789762958.580999:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668672 00000100:00100000:1.0:1789762958.581041:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261009830674 time 261009903906 state 0x0 ref 1 00000100:00100000:1.0:1789762958.581052:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261059903906 time 261009903906 state 0x1 ref 1 00000100:00100000:3.0:1789762958.622739:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261059903906 time 261059974904 state 0x0 ref 1 00000100:00100000:3.0:1789762958.622778:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ff442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668672:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762958.622818:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 100663296, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x30000 00010000:00010000:3.0:1789762958.622825:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.622837:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=261s v=(0 0) 00010000:00010000:3.0:1789762958.622840:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.622845:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.622856:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.626860:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967737 is committed 00002000:00010000:3.0:1789762958.626935:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:3.0:1789762958.626941:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 196608 -> 198656 00010000:00010000:3.0:1789762958.626951:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.626963:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.626974:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.626989:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.626992:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.626999:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.627012:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.627019:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.627082:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ff442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668672:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4329us (46164us total) trans 4294967737 rc 0/0 00000100:00100000:3.0:1789762958.627096:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 310 00000100:00100000:3.0:1789762958.627106:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261059903906 time 261059974904 state 0x2 ref 0 00000100:00100000:2.0:1789762958.629647:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.629681:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668800 00000100:00100000:3.0:1789762958.629690:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668800 00000100:00100000:3.0:1789762958.629724:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261059903906 time 261059974904 state 0x0 ref 1 00000100:00100000:3.0:1789762958.629734:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261109974904 time 261059974904 state 0x1 ref 1 00000001:00080000:1.0:1789762958.651615:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000001:00080000:1.0:1789762958.651625:0:7983:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00000100:00100000:3.0:1789762958.672789:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261109974904 time 261110023548 state 0x0 ref 1 00000100:00100000:3.0:1789762958.672809:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668800:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762958.672852:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 101711872, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x30800 00010000:00010000:3.0:1789762958.672859:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.672873:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=261s v=(0 0) 00010000:00010000:3.0:1789762958.672876:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.672881:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.672893:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.677091:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967738 is committed 00002000:00010000:3.0:1789762958.677147:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:3.0:1789762958.677157:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 198656 -> 200704 00010000:00010000:3.0:1789762958.677166:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.677175:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.677181:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.677186:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.677190:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.677196:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.677209:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.677214:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.677266:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246668800:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4463us (47618us total) trans 4294967738 rc 0/0 00000100:00100000:3.0:1789762958.677272:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 311 00000100:00100000:3.0:1789762958.677280:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261109974904 time 261110023548 state 0x2 ref 0 00000100:00100000:2.0:1789762958.679715:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.679766:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246668928 00000100:00100000:3.0:1789762958.679774:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246668928 00000100:00100000:3.0:1789762958.679808:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261109974904 time 261110023548 state 0x0 ref 1 00000100:00100000:3.0:1789762958.679818:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261160023548 time 261110023548 state 0x1 ref 1 00000100:00100000:2.0:1789762958.722860:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261160023548 time 261160095659 state 0x0 ref 1 00000100:00100000:2.0:1789762958.722879:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668928:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:2.0:1789762958.722925:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 102760448, mtime: 0x6aad9d8e, atime: 0x0, ctime: 0x6aad9d8e, blocks: 0x31000 00010000:00010000:2.0:1789762958.722932:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.722944:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=261s v=(0 0) 00010000:00010000:2.0:1789762958.722947:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762958.722952:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762958.722967:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762958.727035:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967739 is committed 00002000:00010000:1.0:1789762958.727095:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:1.0:1789762958.727099:0:12140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 1789762958 -> 1789762959 00002000:00010000:1.0:1789762958.727101:0:12140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 1789762958 -> 1789762959 00002000:00010000:1.0:1789762958.727103:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 200704 -> 202752 00010000:00010000:1.0:1789762958.727111:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.727119:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.727126:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.727131:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ffd23e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762958.727135:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.727157:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.727174:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.727184:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca8d200/0x5915dfb1c1b5b7d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762958.727248:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246668928:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4373us (47533us total) trans 4294967739 rc 0/0 00000100:00100000:1.0:1789762958.727258:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 312 00000100:00100000:1.0:1789762958.727269:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261160023548 time 261160095659 state 0x2 ref 0 00000100:00100000:0.0:1789762958.729745:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.729793:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246669056 00000100:00100000:3.0:1789762958.729801:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246669056 00000100:00100000:3.0:1789762958.729837:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261160023548 time 261160095659 state 0x0 ref 1 00000100:00100000:3.0:1789762958.729847:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261210095659 time 261160095659 state 0x1 ref 1 00000100:00100000:3.0:1789762958.772923:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261210095659 time 261210151795 state 0x0 ref 1 00000100:00100000:3.0:1789762958.772950:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246669056:12345-192.168.203.36@tcp:4:dd.0 00002000:00010000:3.0:1789762958.772996:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 103809024, mtime: 0x6aad9d8f, atime: 0x0, ctime: 0x6aad9d8f, blocks: 0x31800 00010000:00010000:3.0:1789762958.773003:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.773017:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=261s v=(0 0) 00010000:00010000:3.0:1789762958.773021:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.773026:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.773054:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762958.777365:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967740 is committed 00002000:00010000:3.0:1789762958.777431:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:3.0:1789762958.777436:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 202752 -> 204800 00010000:00010000:3.0:1789762958.777444:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.777453:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.777460:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.777479:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.777482:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.777489:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.777503:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.777508:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7da lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.777570:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246669056:12345-192.168.203.36@tcp:4:dd.0 Request processed in 4628us (47824us total) trans 4294967740 rc 0/0 00000100:00100000:3.0:1789762958.777581:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 313 00000100:00100000:3.0:1789762958.777593:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261210095659 time 261210151795 state 0x2 ref 0 00000100:00100000:2.0:1789762958.778966:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762958.779008:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246669312 00000100:00100000:0.0:1789762958.779017:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246669312 00000100:00100000:0.0:1789762958.779066:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:0.0:1789762958.779075:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:12980:x1876702246669312:12345-192.168.203.36@tcp:35:dd.0 00000100:00080000:3.0:1789762958.779082:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789762958.779224:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967481 00000100:00100000:0.0:1789762958.779297:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12980:x1876702246669312:12345-192.168.203.36@tcp:35:dd.0 Request processed in 222us (330us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789762958.779306:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 69 00000020:00080000:0.0:1789762958.779312:0:5928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789762958.802103:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762958.802148:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246669440 00000100:00100000:0.0:1789762958.802157:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246669440 00000100:00100000:0.0:1789762958.802220:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:0.0:1789762958.802243:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:10429:x1876702246669440:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762958.802258:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789762958.802273:0:5910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789762958.802277:0:5910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1789762953 00002000:00010000:0.0:1789762958.802279:0:5910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1789762953 00002000:00010000:0.0:1789762958.802281:0:5910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:0.0:1789762958.802301:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086485752/0x5915dfb1c1b5b326 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789448b7 expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.802322:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762958.802364:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:10429:x1876702246669440:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 125us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762958.802373:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1789762958.822196:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762958.822249:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246669696 00000100:00100000:0.0:1789762958.822257:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246669696 00000100:00100000:0.0:1789762958.822301:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:0.0:1789762958.822308:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12995:x1876702246669696:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1789762958.822326:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762958.822340:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767cc00/0x5915dfb1c1b5b7e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944943 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.822423:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b7e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.822438:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.822454:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b7e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762958.822489:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 104857600 00010000:00010000:0.0:1789762958.822570:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767cc00/0x5915dfb1c1b5b7e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944943 expref: 13 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.822583:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b7e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944943 expref: 12 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762958.822590:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b33f4535600) 00010000:00010000:0.0:1789762958.822594:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789762958.822597:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767de00, rc 0) 00000100:00100000:0.0:1789762958.822645:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:12995:x1876702246669696:12345-192.168.203.36@tcp:101:dd.0 Request processed in 336us (456us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789762958.822652:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:2.0:1789762958.823835:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.823873:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246669824 00000100:00100000:3.0:1789762958.823879:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246669824 00000100:00100000:3.0:1789762958.823910:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:3.0:1789762958.823917:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2353:x1876702246669824:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762958.823925:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762958.823936:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894494a expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762958.823952:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 104857600, mtime: 0x6aad9d8f, atime: 0x0, ctime: 0x6aad9d8f, blocks: 0x32000 00010000:00010000:3.0:1789762958.823963:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=261s v=(0 0) 00010000:00010000:3.0:1789762958.823966:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.823972:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894494a expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.823983:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894494a expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.823991:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82da00, rc 0) 00000100:00100000:3.0:1789762958.824025:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246669824:12345-192.168.203.36@tcp:101:dd.0 Request processed in 109us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762958.824031:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:2.0:1789762958.826302:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.826341:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246669952 00000100:00100000:3.0:1789762958.826346:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246669952 00000100:00100000:3.0:1789762958.826381:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 255986380902 time 255929061450 state 0x0 ref 1 00000100:00100000:3.0:1789762958.826395:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 256029061450 time 255929061450 state 0x1 ref 1 00000100:00100000:3.0:1789762958.826427:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 256029061450 time 261263668532 state 0x0 ref 1 00000100:00100000:3.0:1789762958.826439:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246669952:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762958.826457:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.826478:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.826481:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.826485:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.826493:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.829841:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.829854:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.829869:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.829874:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.829878:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.829884:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.829896:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.829902:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b7fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.829948:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246669952:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3510us (3645us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762958.829954:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 314 00000100:00100000:3.0:1789762958.829962:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 256029061450 time 261263668532 state 0x2 ref 0 00000100:00100000:2.0:1789762958.832152:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762958.832204:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670080 00000100:00100000:1.0:1789762958.832211:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670080 00000100:00100000:1.0:1789762958.832246:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 256029061450 time 261263668532 state 0x0 ref 1 00000100:00100000:1.0:1789762958.832256:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 2 deadline 261363668532 time 261263668532 state 0x1 ref 1 00000100:00100000:1.0:1789762958.832278:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 1 deadline 261363668532 time 261269523509 state 0x0 ref 1 00000100:00100000:1.0:1789762958.832288:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670080:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762958.832317:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.832326:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762958.832329:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762958.832332:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.832341:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.834841:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.834852:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.834858:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.834863:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762958.834866:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.834871:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.834891:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762958.834897:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5c43a0/0x5915dfb1c1b5b804 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762958.834946:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670080:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2658us (2795us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762958.834952:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 315 00000100:00100000:1.0:1789762958.834959:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 1 deadline 261363668532 time 261269523509 state 0x2 ref 0 00000100:00100000:0.0:1789762958.836793:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.836824:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670208 00000100:00100000:3.0:1789762958.836830:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670208 00000100:00100000:3.0:1789762958.836857:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 1 deadline 261363668532 time 261269523509 state 0x0 ref 1 00000100:00100000:3.0:1789762958.836866:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 1 deadline 261369523509 time 261269523509 state 0x1 ref 1 00000100:00100000:3.0:1789762958.836893:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261369523509 time 261274138140 state 0x0 ref 1 00000100:00100000:3.0:1789762958.836902:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670208:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762958.836921:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.836937:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.836941:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.836946:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.836958:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.839289:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.839299:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.839305:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.839310:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.839312:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.839325:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.839334:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.839338:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b80b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.839376:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670208:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2474us (2584us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762958.839382:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 316 00000100:00100000:3.0:1789762958.839390:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261369523509 time 261274138140 state 0x2 ref 0 00000100:00100000:2.0:1789762958.841010:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762958.841048:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670336 00000100:00100000:3.0:1789762958.841054:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670336 00000100:00100000:3.0:1789762958.841076:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261369523509 time 261274138140 state 0x0 ref 1 00000100:00100000:3.0:1789762958.841083:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261374138140 time 261274138140 state 0x1 ref 1 00000100:00100000:3.0:1789762958.936970:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261374138140 time 261374198063 state 0x0 ref 1 00000100:00100000:3.0:1789762958.937000:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246670336:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762958.937042:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.937073:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.937078:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762958.937085:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.937100:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.940117:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.940130:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.940152:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.940160:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762958.940165:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.940175:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.940192:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762958.940216:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b812 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762958.940270:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246670336:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3281us (99259us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762958.940281:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 317 00000100:00100000:3.0:1789762958.940292:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261374138140 time 261374198063 state 0x2 ref 0 00000100:00100000:0.0:1789762958.942439:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762958.942490:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670464 00000100:00100000:2.0:1789762958.942498:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670464 00000100:00100000:2.0:1789762958.942534:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261374138140 time 261374198063 state 0x0 ref 1 00000100:00100000:2.0:1789762958.942546:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261474198063 time 261374198063 state 0x1 ref 1 00000100:00100000:2.0:1789762959.037033:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261474198063 time 261474265515 state 0x0 ref 1 00000100:00100000:2.0:1789762959.037070:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670464:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762959.037106:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789762959.037110:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762959.037125:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.037129:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.037134:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.037145:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.039742:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.039774:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.039781:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.039793:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762959.039797:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.039804:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.039817:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.039822:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b819 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762959.039868:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670464:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2821us (97430us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762959.039875:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 318 00000100:00100000:2.0:1789762959.039883:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261474198063 time 261474265515 state 0x2 ref 0 00000100:00100000:2.0:1789762959.041740:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762959.041774:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670592 00000100:00100000:3.0:1789762959.041783:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670592 00000100:00100000:3.0:1789762959.041818:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261474198063 time 261474265515 state 0x0 ref 1 00000100:00100000:3.0:1789762959.041829:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261574265515 time 261474265515 state 0x1 ref 1 00000100:00100000:2.0:1789762959.137126:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261574265515 time 261574359056 state 0x0 ref 1 00000100:00100000:2.0:1789762959.137151:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246670592:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762959.137188:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.137217:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.137221:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.137226:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.137237:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.140160:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.140173:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.140180:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.140186:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762959.140189:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.140196:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.140208:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.140224:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000496ab646/0x5915dfb1c1b5b820 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762959.140273:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246670592:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3132us (98533us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762959.140280:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 319 00000100:00100000:2.0:1789762959.140289:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261574265515 time 261574359056 state 0x2 ref 0 00000100:00100000:2.0:1789762959.142316:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762959.142360:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670720 00000100:00100000:3.0:1789762959.142369:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670720 00000100:00100000:3.0:1789762959.142403:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261574265515 time 261574359056 state 0x0 ref 1 00000100:00100000:3.0:1789762959.142413:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261674359056 time 261574359056 state 0x1 ref 1 00010000:00010000:0.0:1789762959.226851:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762959.237206:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261674359056 time 261674440793 state 0x0 ref 1 00000100:00100000:1.0:1789762959.237228:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670720:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762959.237263:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.237277:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762959.237280:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762959.237285:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.237295:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.239912:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.239926:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.239933:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.239939:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff591c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762959.239942:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.239948:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.239962:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.239968:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077c3bbc1/0x5915dfb1c1b5b827 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762959.240016:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670720:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2796us (97700us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762959.240023:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 320 00000100:00100000:1.0:1789762959.240037:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261674359056 time 261674440793 state 0x2 ref 0 00000100:00100000:0.0:1789762959.242195:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762959.242242:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670848 00000100:00100000:2.0:1789762959.242251:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670848 00000100:00100000:2.0:1789762959.242286:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261674359056 time 261674440793 state 0x0 ref 1 00000100:00100000:2.0:1789762959.242297:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261774440793 time 261674440793 state 0x1 ref 1 00000100:00100000:0.0:1789762959.337327:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261774440793 time 261774557591 state 0x0 ref 1 00000100:00100000:0.0:1789762959.337353:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246670848:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762959.337391:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.337404:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.337408:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762959.337425:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762959.337437:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.340211:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.340227:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.340245:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.340253:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff593e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762959.340258:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.340267:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.340283:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.340289:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a757aa/0x5915dfb1c1b5b82e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762959.340335:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246670848:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2992us (98141us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762959.340342:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 321 00000100:00100000:3.0:1789762959.340349:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261774440793 time 261774557591 state 0x2 ref 0 00000100:00100000:2.0:1789762959.342475:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762959.342510:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246670976 00000100:00100000:3.0:1789762959.342517:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246670976 00000100:00100000:3.0:1789762959.342550:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261774440793 time 261774557591 state 0x0 ref 1 00000100:00100000:3.0:1789762959.342569:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261874557591 time 261774557591 state 0x1 ref 1 00000100:00100000:2.0:1789762959.437425:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261874557591 time 261874653066 state 0x0 ref 1 00000100:00100000:2.0:1789762959.437454:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670976:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762959.437503:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.437517:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.437521:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.437536:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.437547:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.440142:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.440157:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.440164:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.440169:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff596000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762959.440173:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.440179:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.440196:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.440205:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b835 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762959.440272:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246670976:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2830us (97815us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762959.440280:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 322 00000100:00100000:2.0:1789762959.440287:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261874557591 time 261874653066 state 0x2 ref 0 00000100:00100000:2.0:1789762959.442454:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762959.442514:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246671104 00000100:00100000:1.0:1789762959.442522:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246671104 00000100:00100000:1.0:1789762959.442558:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261874557591 time 261874653066 state 0x0 ref 1 00000100:00100000:1.0:1789762959.442569:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261974653066 time 261874653066 state 0x1 ref 1 00000100:00100000:3.0:1789762959.537551:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261974653066 time 261974782701 state 0x0 ref 1 00000100:00100000:3.0:1789762959.537574:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671104:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762959.537608:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.537623:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.537627:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762959.537632:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.537643:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.540134:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.540150:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.540160:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.540178:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762959.540182:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.540189:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.540201:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762959.540206:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b83c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762959.540252:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671104:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2687us (97797us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762959.540259:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 323 00000100:00100000:3.0:1789762959.540268:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261974653066 time 261974782701 state 0x2 ref 0 00000100:00100000:0.0:1789762959.542323:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762959.542356:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246671232 00000100:00100000:3.0:1789762959.542364:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246671232 00000100:00100000:3.0:1789762959.542397:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 261974653066 time 261974782701 state 0x0 ref 1 00000100:00100000:3.0:1789762959.542409:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262074782701 time 261974782701 state 0x1 ref 1 00000100:00100000:2.0:1789762959.637659:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262074782701 time 262074889753 state 0x0 ref 1 00000100:00100000:2.0:1789762959.637684:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246671232:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762959.637720:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.637734:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762959.637737:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.637742:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.637790:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.641223:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.641234:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.641251:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.641257:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff596000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762959.641260:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.641266:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.641280:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.641285:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b843 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762959.641333:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246671232:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3660us (99011us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762959.641342:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 324 00000100:00100000:2.0:1789762959.641350:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262074782701 time 262074889753 state 0x2 ref 0 00000100:00100000:0.0:1789762959.643205:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762959.643240:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246671360 00000100:00100000:2.0:1789762959.643247:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246671360 00000100:00100000:2.0:1789762959.643281:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262074782701 time 262074889753 state 0x0 ref 1 00000100:00100000:2.0:1789762959.643300:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262174889753 time 262074889753 state 0x1 ref 1 00000100:00100000:2.0:1789762959.737780:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262174889753 time 262174980026 state 0x0 ref 1 00000100:00100000:2.0:1789762959.737805:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671360:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762959.737842:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.737856:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.737860:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.737872:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.737884:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.740213:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.740225:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.740235:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.740244:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff596000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762959.740250:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.740260:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.740278:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.740302:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dd4fcd2/0x5915dfb1c1b5b84a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762959.740360:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671360:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2564us (97155us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762959.740371:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 325 00000100:00100000:1.0:1789762959.740382:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262174889753 time 262174980026 state 0x2 ref 0 00000100:00100000:0.0:1789762959.742410:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762959.742469:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246671488 00000100:00100000:2.0:1789762959.742477:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246671488 00000100:00100000:2.0:1789762959.742519:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262174889753 time 262174980026 state 0x0 ref 1 00000100:00100000:2.0:1789762959.742535:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262274980026 time 262174980026 state 0x1 ref 1 00000100:00100000:2.0:1789762959.837838:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262274980026 time 262275069885 state 0x0 ref 1 00000100:00100000:2.0:1789762959.837864:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246671488:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762959.837912:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.837934:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.837938:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762959.837942:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.837953:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.841011:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.841024:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.841034:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.841043:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff597800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762959.841048:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.841058:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.841083:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762959.841089:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef3ed249/0x5915dfb1c1b5b851 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762959.841136:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246671488:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3283us (98726us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762959.841142:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 326 00000100:00100000:2.0:1789762959.841150:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262274980026 time 262275069885 state 0x2 ref 0 00000100:00100000:2.0:1789762959.843349:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762959.843400:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246671616 00000100:00100000:3.0:1789762959.843417:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246671616 00000100:00100000:3.0:1789762959.843474:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262274980026 time 262275069885 state 0x0 ref 1 00000100:00100000:3.0:1789762959.843486:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262375069885 time 262275069885 state 0x1 ref 1 00000100:00100000:1.0:1789762959.937931:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262375069885 time 262375159076 state 0x0 ref 1 00000100:00100000:1.0:1789762959.937959:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246671616:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762959.938000:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.938017:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762959.938022:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762959.938029:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.938044:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.941098:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.941129:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.941139:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.941147:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762959.941152:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.941162:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.941180:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762959.941188:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a3d309/0x5915dfb1c1b5b858 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762959.941245:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246671616:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3295us (97894us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762959.941255:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 327 00000100:00100000:1.0:1789762959.941266:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262375069885 time 262375159076 state 0x2 ref 0 00000100:00100000:0.0:1789762959.943665:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762959.943707:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246671744 00000100:00100000:1.0:1789762959.943721:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246671744 00000100:00100000:1.0:1789762959.943781:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262375069885 time 262375159076 state 0x0 ref 1 00000100:00100000:1.0:1789762959.943795:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262475159076 time 262375159076 state 0x1 ref 1 00000100:00100000:3.0:1789762960.038056:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262475159076 time 262475288757 state 0x0 ref 1 00000100:00100000:3.0:1789762960.038081:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671744:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762960.038125:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.038143:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.038148:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.038155:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.038170:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.041032:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.041042:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.041048:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.041060:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762960.041064:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.041070:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.041083:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.041088:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b85f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.041140:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671744:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3067us (97474us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.041150:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 328 00000100:00100000:3.0:1789762960.041161:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262475159076 time 262475288757 state 0x2 ref 0 00000100:00100000:2.0:1789762960.043510:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762960.043560:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246671872 00000100:00100000:3.0:1789762960.043569:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246671872 00000100:00100000:3.0:1789762960.043612:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262475159076 time 262475288757 state 0x0 ref 1 00000100:00100000:3.0:1789762960.043625:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262575288757 time 262475288757 state 0x1 ref 1 00000100:00100000:2.0:1789762960.138212:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262575288757 time 262575443288 state 0x0 ref 1 00000100:00100000:2.0:1789762960.138237:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671872:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762960.138275:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.138289:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.138293:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.138298:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.138327:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.141045:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.141056:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.141063:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.141067:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff8c6000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762960.141071:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.141077:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.141090:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.141094:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ac960fb/0x5915dfb1c1b5b866 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762960.141154:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246671872:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2927us (97645us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762960.141161:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 329 00000100:00100000:1.0:1789762960.141169:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262575288757 time 262575443288 state 0x2 ref 0 00000100:00100000:0.0:1789762960.143547:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762960.143585:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672000 00000100:00100000:1.0:1789762960.143593:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672000 00000100:00100000:1.0:1789762960.143626:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262575288757 time 262575443288 state 0x0 ref 1 00000100:00100000:1.0:1789762960.143637:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262675443288 time 262575443288 state 0x1 ref 1 00000100:00100000:2.0:1789762960.238329:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262675443288 time 262675560830 state 0x0 ref 1 00000100:00100000:2.0:1789762960.238353:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672000:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762960.238388:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.238402:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.238406:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.238411:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.238422:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.241326:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.241337:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.241344:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.241360:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff8c6c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762960.241364:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.241370:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.241382:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.241387:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b86d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762960.241437:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672000:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3093us (97892us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762960.241444:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 330 00000100:00100000:2.0:1789762960.241468:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262675443288 time 262675560830 state 0x2 ref 0 00000100:00100000:0.0:1789762960.243857:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762960.243903:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672128 00000100:00100000:3.0:1789762960.243918:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672128 00000100:00100000:3.0:1789762960.243958:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262675443288 time 262675560830 state 0x0 ref 1 00000100:00100000:3.0:1789762960.243973:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262775560830 time 262675560830 state 0x1 ref 1 00010000:00010000:1.0:1789762960.250848:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762960.338495:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262775560830 time 262775727427 state 0x0 ref 1 00000100:00100000:2.0:1789762960.338520:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672128:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762960.338556:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.338587:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.338590:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.338595:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.338605:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.341236:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.341250:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.341257:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.341263:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff8c6c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762960.341266:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.341272:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.341286:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.341301:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b874 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762960.341350:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672128:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2839us (97494us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762960.341357:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 331 00000100:00100000:2.0:1789762960.341365:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262775560830 time 262775727427 state 0x2 ref 0 00000100:00100000:1.0:1789762960.343379:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762960.343422:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672256 00000100:00100000:2.0:1789762960.343429:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672256 00000100:00100000:2.0:1789762960.343483:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262775560830 time 262775727427 state 0x0 ref 1 00000100:00100000:2.0:1789762960.343493:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262875727427 time 262775727427 state 0x1 ref 1 00000100:00100000:2.0:1789762960.438605:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262875727427 time 262875832758 state 0x0 ref 1 00000100:00100000:2.0:1789762960.438634:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672256:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762960.438669:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.438683:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.438687:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.438692:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.438718:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.441347:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.441355:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.441361:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.441366:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff8c6c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762960.441369:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.441375:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.441391:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.441399:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b87b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762960.441484:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672256:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2860us (98104us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762960.441494:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 332 00000100:00100000:2.0:1789762960.441504:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262875727427 time 262875832758 state 0x2 ref 0 00000100:00100000:1.0:1789762960.443664:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762960.443710:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672384 00000100:00100000:2.0:1789762960.443718:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672384 00000100:00100000:2.0:1789762960.443771:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262875727427 time 262875832758 state 0x0 ref 1 00000100:00100000:2.0:1789762960.443782:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262975832758 time 262875832758 state 0x1 ref 1 00000100:00100000:2.0:1789762960.538683:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262975832758 time 262975914722 state 0x0 ref 1 00000100:00100000:2.0:1789762960.538706:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672384:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762960.538747:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.538799:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.538805:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762960.538811:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.538828:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.541671:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.541679:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.541686:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.541691:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff8c6c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762960.541694:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.541700:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.541715:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762960.541720:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005657c4ea/0x5915dfb1c1b5b882 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762960.541797:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672384:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3097us (98131us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762960.541808:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 333 00000100:00100000:2.0:1789762960.541826:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262975832758 time 262975914722 state 0x2 ref 0 00000100:00100000:0.0:1789762960.543845:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762960.543880:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672512 00000100:00100000:2.0:1789762960.543889:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672512 00000100:00100000:2.0:1789762960.543923:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 262975832758 time 262975914722 state 0x0 ref 1 00000100:00100000:2.0:1789762960.543934:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263075914722 time 262975914722 state 0x1 ref 1 00000100:00100000:1.0:1789762960.638825:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263075914722 time 263076058187 state 0x0 ref 1 00000100:00100000:1.0:1789762960.638850:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672512:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762960.638887:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.638901:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789762960.638904:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762960.638909:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.638938:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.641491:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.641502:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.641509:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.641514:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4b6ea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762960.641517:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.641523:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.641536:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.641541:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b889 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762960.641598:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672512:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2757us (97753us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762960.641605:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 334 00000100:00100000:1.0:1789762960.641613:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263075914722 time 263076058187 state 0x2 ref 0 00000100:00100000:0.0:1789762960.643501:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762960.643543:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672640 00000100:00100000:2.0:1789762960.643550:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672640 00000100:00100000:2.0:1789762960.643584:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263075914722 time 263076058187 state 0x0 ref 1 00000100:00100000:2.0:1789762960.643595:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263176058187 time 263076058187 state 0x1 ref 1 00000100:00100000:3.0:1789762960.738943:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263176058187 time 263176175702 state 0x0 ref 1 00000100:00100000:3.0:1789762960.738968:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672640:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762960.739003:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.739017:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.739020:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.739025:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.739035:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.741784:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.741797:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.741806:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.741823:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762960.741828:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.741838:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.741854:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.741862:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b890 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.741916:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672640:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2957us (98415us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.741927:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 335 00000100:00100000:3.0:1789762960.741938:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263176058187 time 263176175702 state 0x2 ref 0 00000100:00100000:2.0:1789762960.744031:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762960.744069:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672768 00000100:00100000:3.0:1789762960.744078:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672768 00000100:00100000:3.0:1789762960.744117:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263176058187 time 263176175702 state 0x0 ref 1 00000100:00100000:3.0:1789762960.744131:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263276175702 time 263176175702 state 0x1 ref 1 00000100:00100000:1.0:1789762960.839073:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263276175702 time 263276305260 state 0x0 ref 1 00000100:00100000:1.0:1789762960.839100:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672768:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762960.839151:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.839168:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762960.839171:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762960.839176:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.839188:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.841858:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.841869:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.841890:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.841895:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4b6ea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762960.841898:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.841904:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.841917:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762960.841923:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b897 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762960.841967:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246672768:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2879us (97935us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762960.841975:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 336 00000100:00100000:1.0:1789762960.841983:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263276175702 time 263276305260 state 0x2 ref 0 00000100:00100000:1.0:1789762960.843820:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762960.843865:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246672896 00000100:00100000:3.0:1789762960.843880:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246672896 00000100:00100000:3.0:1789762960.843921:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263276175702 time 263276305260 state 0x0 ref 1 00000100:00100000:3.0:1789762960.843934:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263376305260 time 263276305260 state 0x1 ref 1 00000100:00100000:3.0:1789762960.939135:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263376305260 time 263376363590 state 0x0 ref 1 00000100:00100000:3.0:1789762960.939164:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672896:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762960.939205:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.939223:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.939227:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762960.939233:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.939248:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.942379:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.942391:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.942400:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.942421:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762960.942427:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.942436:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.942465:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762960.942473:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b89e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762960.942529:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246672896:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3376us (98709us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762960.942540:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 337 00000100:00100000:3.0:1789762960.942550:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263376305260 time 263376363590 state 0x2 ref 0 00000100:00100000:1.0:1789762960.944430:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762960.944489:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673024 00000100:00100000:3.0:1789762960.944497:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673024 00000100:00100000:3.0:1789762960.944534:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263376305260 time 263376363590 state 0x0 ref 1 00000100:00100000:3.0:1789762960.944548:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263476363590 time 263376363590 state 0x1 ref 1 00000100:00100000:2.0:1789762961.039276:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263476363590 time 263476508048 state 0x0 ref 1 00000100:00100000:2.0:1789762961.039315:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673024:12345-192.168.203.36@tcp:3:dd.0 00000100:00080000:3.0:1789762961.039337:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762961.039355:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.039370:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.039374:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.039379:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.039401:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.042153:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.042165:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.042171:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.042177:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762961.042180:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.042186:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.042199:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.042204:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d1b8e4/0x5915dfb1c1b5b8a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.042253:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673024:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2963us (97823us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.042260:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 338 00000100:00100000:3.0:1789762961.042268:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263476363590 time 263476508048 state 0x2 ref 0 00000100:00100000:1.0:1789762961.044094:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762961.044141:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673152 00000100:00100000:2.0:1789762961.044150:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673152 00000100:00100000:2.0:1789762961.044184:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263476363590 time 263476508048 state 0x0 ref 1 00000100:00100000:2.0:1789762961.044194:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263576508048 time 263476508048 state 0x1 ref 1 00000100:00100000:2.0:1789762961.139361:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263576508048 time 263576592334 state 0x0 ref 1 00000100:00100000:2.0:1789762961.139387:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673152:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762961.139423:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.139437:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.139441:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.139461:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.139473:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.142413:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.142433:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.142439:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.142455:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efa00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762961.142459:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.142465:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.142478:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.142484:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762961.142539:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673152:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3162us (98452us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762961.142549:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 339 00000100:00100000:2.0:1789762961.142557:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263576508048 time 263576592334 state 0x2 ref 0 00000100:00100000:0.0:1789762961.144534:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.144580:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673280 00000100:00100000:3.0:1789762961.144587:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673280 00000100:00100000:3.0:1789762961.144621:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263576508048 time 263576592334 state 0x0 ref 1 00000100:00100000:3.0:1789762961.144632:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263676592334 time 263576592334 state 0x1 ref 1 00000100:00100000:2.0:1789762961.210901:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254934784:0@lo:400:kworker.0 00000100:00100000:0.0:1789762961.210914:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254935040:0@lo:400:kworker.0 00000100:00100000:3.0:1789762961.210914:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254934912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762961.210938:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254935168:0@lo:400:kworker.0 00000100:00100000:2.0:1789762961.210983:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762961.210990:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762961.210990:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762961.211022:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254934784 00000100:00100000:1.0:1789762961.211030:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254934784 00000100:00100000:0.0:1789762961.211052:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254935552:0@lo:400:kworker.0 00000100:00100000:3.0:1789762961.211052:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254935296:0@lo:400:kworker.0 00000100:00100000:2.0:1789762961.211053:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254935424:0@lo:400:kworker.0 00000100:00100000:1.0:1789762961.211079:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789762961.211090:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254934784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762961.211100:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762961.211106:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762961.211124:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935040 00000100:00100000:0.0:1789762961.211130:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935040 00000100:00100000:1.0:1789762961.211157:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254934784:12345-0@lo:400:kworker.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762961.211165:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254934784:0@lo:400:kworker.0 00000100:00100000:1.0:1789762961.211166:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789762961.211170:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762961.211171:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935424 00000100:00100000:0.0:1789762961.211175:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935424 00000100:00100000:2.0:1789762961.211216:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254934912 00000100:00100000:2.0:1789762961.211221:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254934912 00000100:00100000:3.0:1789762961.211224:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935296 00000100:00100000:1.0:1789762961.211225:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789762961.211231:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935296 00000100:00100000:0.0:1789762961.211235:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789762961.211239:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254935040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762961.211247:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762961.211261:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789762961.211272:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254934912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762961.211279:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935552 00000100:00100000:3.0:1789762961.211284:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935552 00000100:00100000:1.0:1789762961.211288:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1876702254935040:12345-0@lo:400:kworker.0 Request processed in 52us (300us total) trans 0 rc 0/0 00002000:00000024:2.0:1789762961.211294:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33784384 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762961.211295:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789762961.211311:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1876702254935424:12345-0@lo:400:kworker.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762961.211314:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789762961.211320:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789762961.211326:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254935296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762961.211334:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789762961.211347:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254935552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762961.211348:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254934912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00080000:0.0:1789762961.211357:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762961.211362:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789762961.211365:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789762961.211371:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762961.211378:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254935296:12345-0@lo:400:kworker.0 Request processed in 55us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762961.211396:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789762961.211401:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254935552:12345-0@lo:400:kworker.0 Request processed in 57us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762961.211409:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254935296:0@lo:400:kworker.0 00000100:00100000:1.0:1789762961.211414:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789762961.211420:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762961.211430:0:3419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:2.0:1789762961.211436:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c2128000, transno 4294967336 00000004:00080000:2.0:1789762961.211462:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c212b480, transno 4294967337 00000100:00100000:1.0:1789762961.211465:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935168 00000100:00100000:3.0:1789762961.211467:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1876702254935424:0@lo:400:kworker.0 00000100:00100000:1.0:1789762961.211470:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935168 00000100:00100000:2.0:1789762961.211476:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254934912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789762961.211509:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254935552:0@lo:400:kworker.0 00000100:00100000:1.0:1789762961.211515:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789762961.211522:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254935168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789762961.211527:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789762961.211541:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1876702254935040:0@lo:400:kworker.0 00000100:00100000:1.0:1789762961.211566:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1876702254935168:12345-0@lo:400:kworker.0 Request processed in 42us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762961.211579:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789762961.211588:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1876702254935168:0@lo:400:kworker.0 00000100:00100000:2.0:1789762961.239430:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263676592334 time 263676663972 state 0x0 ref 1 00000100:00100000:2.0:1789762961.239463:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673280:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762961.239497:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.239524:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.239530:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.239536:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.239547:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.242190:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.242201:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.242214:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.242219:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13efa00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762961.242223:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.242229:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.242242:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.242248:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdb0d59b/0x5915dfb1c1b5b8b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.242293:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673280:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2850us (97760us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.242300:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 340 00000100:00100000:3.0:1789762961.242307:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263676592334 time 263676663972 state 0x2 ref 0 00000100:00100000:0.0:1789762961.244148:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.244183:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673408 00000100:00100000:3.0:1789762961.244191:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673408 00000100:00100000:3.0:1789762961.244220:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263676592334 time 263676663972 state 0x0 ref 1 00000100:00100000:3.0:1789762961.244239:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263776663972 time 263676663972 state 0x1 ref 1 00010000:00010000:3.0:1789762961.274917:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762961.339530:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263776663972 time 263776763275 state 0x0 ref 1 00000100:00100000:3.0:1789762961.339554:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673408:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762961.339588:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.339602:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.339606:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.339611:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.339621:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.342569:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.342581:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.342588:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.342604:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762961.342607:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.342614:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.342626:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.342631:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.342677:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673408:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3133us (98529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.342684:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 341 00000100:00100000:3.0:1789762961.342692:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263776663972 time 263776763275 state 0x2 ref 0 00000100:00100000:0.0:1789762961.344653:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762961.344701:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673536 00000100:00100000:2.0:1789762961.344709:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673536 00000100:00100000:2.0:1789762961.344744:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263776663972 time 263776763275 state 0x0 ref 1 00000100:00100000:2.0:1789762961.344773:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263876763275 time 263776763275 state 0x1 ref 1 00000100:00100000:0.0:1789762961.439629:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263876763275 time 263876861730 state 0x0 ref 1 00000100:00100000:0.0:1789762961.439651:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673536:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762961.439685:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.439699:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762961.439702:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762961.439707:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.439718:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.442710:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.442722:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.442728:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.442740:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cefa00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762961.442744:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.442768:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.442782:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.442788:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043860527/0x5915dfb1c1b5b8c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.442834:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673536:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3190us (98181us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.442843:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 342 00000100:00100000:3.0:1789762961.442853:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263876763275 time 263876861730 state 0x2 ref 0 00000100:00100000:2.0:1789762961.444809:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.444844:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673664 00000100:00100000:3.0:1789762961.444853:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673664 00000100:00100000:3.0:1789762961.444896:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263876763275 time 263876861730 state 0x0 ref 1 00000100:00100000:3.0:1789762961.444908:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263976861730 time 263876861730 state 0x1 ref 1 00000100:00100000:2.0:1789762961.539781:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263976861730 time 263976974937 state 0x0 ref 1 00000100:00100000:2.0:1789762961.539805:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673664:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762961.539840:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.539853:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.539857:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.539861:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.539887:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.542340:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.542352:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.542377:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.542394:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9a3800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762961.542399:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.542409:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.542427:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.542435:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529662ff/0x5915dfb1c1b5b8c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762961.542511:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673664:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2712us (97701us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762961.542520:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 343 00000100:00100000:0.0:1789762961.542531:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263976861730 time 263976974937 state 0x2 ref 0 00000100:00100000:2.0:1789762961.544495:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.544542:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673792 00000100:00100000:3.0:1789762961.544556:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673792 00000100:00100000:3.0:1789762961.544589:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 263976861730 time 263976974937 state 0x0 ref 1 00000100:00100000:3.0:1789762961.544599:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264076974937 time 263976974937 state 0x1 ref 1 00000100:00100000:2.0:1789762961.639858:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264076974937 time 264077085227 state 0x0 ref 1 00000100:00100000:2.0:1789762961.639888:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673792:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762961.639932:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.639947:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762961.639950:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.639955:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.639967:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.642580:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.642590:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.642597:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.642613:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9a3e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762961.642617:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.642623:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.642636:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.642641:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762961.642694:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246673792:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2817us (98201us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762961.642701:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 344 00000100:00100000:2.0:1789762961.642708:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264076974937 time 264077085227 state 0x2 ref 0 00000100:00100000:2.0:1789762961.644657:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.644697:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246673920 00000100:00100000:3.0:1789762961.644707:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246673920 00000100:00100000:3.0:1789762961.644741:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264076974937 time 264077085227 state 0x0 ref 1 00000100:00100000:3.0:1789762961.644770:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264177085227 time 264077085227 state 0x1 ref 1 00000100:00100000:2.0:1789762961.739962:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264177085227 time 264177193284 state 0x0 ref 1 00000100:00100000:2.0:1789762961.739985:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673920:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762961.740022:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.740051:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.740055:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.740060:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.740070:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.742773:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.742784:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.742791:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.742796:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9a3e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762961.742800:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.742806:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.742829:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.742835:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0acd8f8/0x5915dfb1c1b5b8d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.742904:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246673920:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2926us (98245us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.742913:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 345 00000100:00100000:3.0:1789762961.742924:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264177085227 time 264177193284 state 0x2 ref 0 00000100:00100000:1.0:1789762961.744862:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762961.744907:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674048 00000100:00100000:0.0:1789762961.744915:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674048 00000100:00100000:0.0:1789762961.744951:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264177085227 time 264177193284 state 0x0 ref 1 00000100:00100000:0.0:1789762961.744971:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264277193284 time 264177193284 state 0x1 ref 1 00000100:00100000:2.0:1789762961.795656:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762961.795687:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.795704:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674176 00000100:00100000:2.0:1789762961.795710:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.795714:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674176 00000100:00100000:1.0:1789762961.795737:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674304 00000100:00100000:1.0:1789762961.795782:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674304 00000100:00100000:2.0:1789762961.795782:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762961.795788:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674560 00000100:00100000:0.0:1789762961.795795:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674560 00000100:00100000:3.0:1789762961.795796:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 277 00000100:00100000:3.0:1789762961.795810:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246674176:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762961.795812:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674432 00000100:00100000:2.0:1789762961.795819:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674432 00000100:00100000:1.0:1789762961.795841:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:1.0:1789762961.795853:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2356:x1876702246674304:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762961.795860:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:2.0:1789762961.795869:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:0.0:1789762961.795875:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246674560:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762961.795880:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246674176:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762961.795889:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246674432:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762961.795894:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 277 00000100:00100000:1.0:1789762961.795900:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2356:x1876702246674304:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762961.795908:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:0.0:1789762961.795927:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246674560:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00080000:1.0:1789762961.795933:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762961.795939:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762961.795942:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246674432:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 57us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762961.795943:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:2.0:1789762961.795955:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:2.0:1789762961.840047:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264277193284 time 264277281554 state 0x0 ref 1 00000100:00100000:2.0:1789762961.840066:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246674048:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762961.840098:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.840125:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.840129:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762961.840134:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762961.840145:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.842810:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.842820:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.842827:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.842839:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9a2200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762961.842843:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.842849:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.842866:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.842874:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000513073e/0x5915dfb1c1b5b8dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762961.842932:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246674048:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2869us (98068us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762961.842942:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 346 00000100:00100000:3.0:1789762961.842954:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264277193284 time 264277281554 state 0x2 ref 0 00000100:00100000:3.0:1789762961.844870:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762961.844915:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674688 00000100:00100000:2.0:1789762961.844924:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674688 00000100:00100000:2.0:1789762961.844965:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264277193284 time 264277281554 state 0x0 ref 1 00000100:00100000:2.0:1789762961.844975:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264377281554 time 264277281554 state 0x1 ref 1 00000100:00100000:3.0:1789762961.940151:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264377281554 time 264377382427 state 0x0 ref 1 00000100:00100000:3.0:1789762961.940175:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246674688:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762961.940218:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.940249:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.940252:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762961.940257:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762961.940268:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.942917:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.942930:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.942939:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.942944:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762961.942948:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.942955:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.942979:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762961.942985:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074dcc563/0x5915dfb1c1b5b8e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762961.943030:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246674688:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2865us (98162us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762961.943037:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 347 00000100:00100000:0.0:1789762961.943044:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264377281554 time 264377382427 state 0x2 ref 0 00000100:00100000:1.0:1789762961.944974:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762961.945015:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674816 00000100:00100000:3.0:1789762961.945023:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674816 00000100:00100000:3.0:1789762961.945056:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264377281554 time 264377382427 state 0x0 ref 1 00000100:00100000:3.0:1789762961.945067:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264477382427 time 264377382427 state 0x1 ref 1 00000100:00100000:3.0:1789762962.040241:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264477382427 time 264477473907 state 0x0 ref 1 00000100:00100000:3.0:1789762962.040266:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246674816:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762962.040302:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.040316:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.040320:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.040325:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.040352:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.043216:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.043225:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.043231:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.043236:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762962.043239:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.043245:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.043256:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.043261:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.043316:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246674816:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3060us (98344us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.043323:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 348 00000100:00100000:3.0:1789762962.043330:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264477382427 time 264477473907 state 0x2 ref 0 00000100:00100000:2.0:1789762962.045255:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762962.045288:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246674944 00000100:00100000:3.0:1789762962.045295:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246674944 00000100:00100000:3.0:1789762962.045329:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264477382427 time 264477473907 state 0x0 ref 1 00000100:00100000:3.0:1789762962.045338:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264577473907 time 264477473907 state 0x1 ref 1 00000100:00100000:3.0:1789762962.140339:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264577473907 time 264577567364 state 0x0 ref 1 00000100:00100000:3.0:1789762962.140369:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246674944:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762962.140409:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.140425:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.140429:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.140436:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.140465:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.143355:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.143368:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.143377:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.143386:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762962.143390:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.143400:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.143417:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.143425:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000effcefca/0x5915dfb1c1b5b8f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.143492:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246674944:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3134us (98237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.143502:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 349 00000100:00100000:3.0:1789762962.143519:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264577473907 time 264577567364 state 0x2 ref 0 00000100:00100000:2.0:1789762962.145492:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762962.145543:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675072 00000100:00100000:0.0:1789762962.145551:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675072 00000100:00100000:0.0:1789762962.145587:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264577473907 time 264577567364 state 0x0 ref 1 00000100:00100000:0.0:1789762962.145598:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264677567364 time 264577567364 state 0x1 ref 1 00000100:00100000:0.0:1789762962.240393:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264677567364 time 264677621169 state 0x0 ref 1 00000100:00100000:0.0:1789762962.240423:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675072:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762962.240478:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.240491:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.240508:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.240513:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.240525:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.243404:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.243420:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.243430:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.243435:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762962.243453:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.243462:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.243476:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.243482:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf129fb4/0x5915dfb1c1b5b8f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762962.243538:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675072:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3127us (98047us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762962.243546:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 350 00000100:00100000:0.0:1789762962.243553:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264677567364 time 264677621169 state 0x2 ref 0 00000100:00100000:1.0:1789762962.245518:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762962.245561:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675200 00000100:00100000:3.0:1789762962.245570:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675200 00000100:00100000:3.0:1789762962.245603:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264677567364 time 264677621169 state 0x0 ref 1 00000100:00100000:3.0:1789762962.245613:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264777621169 time 264677621169 state 0x1 ref 1 00010000:00010000:1.0:1789762962.298874:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762962.340506:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264777621169 time 264777738572 state 0x0 ref 1 00000100:00100000:2.0:1789762962.340533:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675200:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762962.340570:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.340583:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762962.340587:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762962.340591:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.340615:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.343341:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.343352:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.343358:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.343363:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762962.343367:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.343373:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.343384:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.343389:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b900 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762962.343458:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675200:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2936us (97940us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762962.343465:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 351 00000100:00100000:2.0:1789762962.343473:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264777621169 time 264777738572 state 0x2 ref 0 00000100:00100000:3.0:1789762962.345392:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762962.345425:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675328 00000100:00100000:2.0:1789762962.345433:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675328 00000100:00100000:2.0:1789762962.345482:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264777621169 time 264777738572 state 0x0 ref 1 00000100:00100000:2.0:1789762962.345492:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264877738572 time 264777738572 state 0x1 ref 1 00000100:00100000:3.0:1789762962.440611:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264877738572 time 264877842605 state 0x0 ref 1 00000100:00100000:3.0:1789762962.440639:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c212b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675328:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762962.440677:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.440690:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.440694:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.440699:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.440710:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.443895:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.443905:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.443912:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.443917:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4b6ea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762962.443920:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.443927:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.443947:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.443952:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e9952a/0x5915dfb1c1b5b907 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762962.444002:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c212b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675328:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3374us (98610us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762962.444010:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 352 00000100:00100000:2.0:1789762962.444017:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264877738572 time 264877842605 state 0x2 ref 0 00000100:00100000:3.0:1789762962.445885:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762962.445936:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675456 00000100:00100000:0.0:1789762962.445947:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675456 00000100:00100000:0.0:1789762962.445989:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264877738572 time 264877842605 state 0x0 ref 1 00000100:00100000:0.0:1789762962.446000:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264977842605 time 264877842605 state 0x1 ref 1 00000100:00100000:2.0:1789762962.540720:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264977842605 time 264977950874 state 0x0 ref 1 00000100:00100000:2.0:1789762962.540780:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675456:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762962.540818:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.540832:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762962.540835:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762962.540840:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.540851:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.543720:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.543742:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.543773:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.543783:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762962.543787:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.543797:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.543818:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762962.543824:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e726d47/0x5915dfb1c1b5b90e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762962.543870:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675456:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3134us (97985us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762962.543876:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 353 00000100:00100000:2.0:1789762962.543889:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264977842605 time 264977950874 state 0x2 ref 0 00000100:00100000:3.0:1789762962.545797:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762962.545829:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675584 00000100:00100000:2.0:1789762962.545838:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675584 00000100:00100000:2.0:1789762962.545871:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 264977842605 time 264977950874 state 0x0 ref 1 00000100:00100000:2.0:1789762962.545882:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265077950874 time 264977950874 state 0x1 ref 1 00000100:00100000:0.0:1789762962.640847:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265077950874 time 265078077774 state 0x0 ref 1 00000100:00100000:0.0:1789762962.640871:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f7648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675584:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762962.640910:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.640924:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762962.640928:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.640933:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.640945:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.643861:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.643878:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.643884:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.643889:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff58a600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762962.643893:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.643899:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.643912:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.643917:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006de29bc6/0x5915dfb1c1b5b915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.643969:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f7648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675584:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3105us (98171us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.643980:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 354 00000100:00100000:3.0:1789762962.643991:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265077950874 time 265078077774 state 0x2 ref 0 00000100:00100000:3.0:1789762962.646036:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762962.646085:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675712 00000100:00100000:2.0:1789762962.646093:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675712 00000100:00100000:2.0:1789762962.646134:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265077950874 time 265078077774 state 0x0 ref 1 00000100:00100000:2.0:1789762962.646145:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265178077774 time 265078077774 state 0x1 ref 1 00000100:00100000:3.0:1789762962.741013:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265178077774 time 265178239496 state 0x0 ref 1 00000100:00100000:3.0:1789762962.741054:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3400419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675712:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762962.741104:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.741120:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.741124:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.741128:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.741140:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.743782:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.743792:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.743799:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.743804:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4b6f200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762962.743808:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.743825:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.743839:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.743844:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b91c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.743890:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3400419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675712:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2860us (97853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.743897:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 355 00000100:00100000:3.0:1789762962.743904:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265178077774 time 265178239496 state 0x2 ref 0 00000100:00100000:3.0:1789762962.745808:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762962.745885:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675840 00000100:00100000:2.0:1789762962.745893:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675840 00000100:00100000:2.0:1789762962.745938:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265178077774 time 265178239496 state 0x0 ref 1 00000100:00100000:2.0:1789762962.745953:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265278239496 time 265178239496 state 0x1 ref 1 00000100:00100000:3.0:1789762962.841132:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265278239496 time 265278363667 state 0x0 ref 1 00000100:00100000:3.0:1789762962.841163:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675840:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762962.841199:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.841213:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.841217:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762962.841221:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.841246:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.844358:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.844368:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.844374:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.844379:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c4b6f200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762962.844382:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.844389:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.844402:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762962.844406:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6ea29f4/0x5915dfb1c1b5b923 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762962.844471:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246675840:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3325us (98663us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762962.844478:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 356 00000100:00100000:3.0:1789762962.844485:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265278239496 time 265278363667 state 0x2 ref 0 00000100:00100000:3.0:1789762962.846413:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762962.846473:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246675968 00000100:00100000:0.0:1789762962.846481:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246675968 00000100:00100000:0.0:1789762962.846518:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265278239496 time 265278363667 state 0x0 ref 1 00000100:00100000:0.0:1789762962.846528:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265378363667 time 265278363667 state 0x1 ref 1 00000100:00100000:0.0:1789762962.941177:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265378363667 time 265378408911 state 0x0 ref 1 00000100:00100000:0.0:1789762962.941203:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675968:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762962.941253:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.941271:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.941276:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762962.941281:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.941294:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.944225:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.944235:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.944250:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.944256:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff58ea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762962.944259:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.944265:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.944278:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762962.944284:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5bfbfa/0x5915dfb1c1b5b92a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762962.944330:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246675968:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3138us (97916us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762962.944336:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 357 00000100:00100000:0.0:1789762962.944344:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265378363667 time 265378408911 state 0x2 ref 0 00000100:00100000:1.0:1789762962.946336:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762962.946385:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676096 00000100:00100000:3.0:1789762962.946395:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676096 00000100:00100000:3.0:1789762962.946452:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265378363667 time 265378408911 state 0x0 ref 1 00000100:00100000:3.0:1789762962.946468:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265478408911 time 265378408911 state 0x1 ref 1 00000100:00100000:1.0:1789762963.041290:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265478408911 time 265478522049 state 0x0 ref 1 00000100:00100000:1.0:1789762963.041327:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676096:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762963.041364:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789762963.041368:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762963.041382:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762963.041387:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762963.041395:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.041409:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.043688:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.043708:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.043715:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.043720:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff588600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762963.043723:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.043729:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.043743:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.043748:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8cc7187/0x5915dfb1c1b5b931 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762963.043815:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676096:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2510us (97479us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762963.043822:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 358 00000100:00100000:1.0:1789762963.043829:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265478408911 time 265478522049 state 0x2 ref 0 00000100:00100000:1.0:1789762963.045690:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762963.045745:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676224 00000100:00100000:3.0:1789762963.045779:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676224 00000100:00100000:3.0:1789762963.045821:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265478408911 time 265478522049 state 0x0 ref 1 00000100:00100000:3.0:1789762963.045837:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265578522049 time 265478522049 state 0x1 ref 1 00000100:00100000:2.0:1789762963.141478:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265578522049 time 265578709726 state 0x0 ref 1 00000100:00100000:2.0:1789762963.141504:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676224:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762963.141542:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.141574:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.141578:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.141583:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.141594:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.144181:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.144190:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.144196:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.144202:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff608200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762963.144205:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.144211:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.144224:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.144239:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b938 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762963.144284:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676224:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2791us (98593us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762963.144290:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 359 00000100:00100000:2.0:1789762963.144297:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265578522049 time 265578709726 state 0x2 ref 0 00000100:00100000:3.0:1789762963.146783:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762963.146825:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676352 00000100:00100000:0.0:1789762963.146837:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676352 00000100:00100000:0.0:1789762963.146895:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265578522049 time 265578709726 state 0x0 ref 1 00000100:00100000:0.0:1789762963.146930:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265678709726 time 265578709726 state 0x1 ref 1 00000100:00100000:2.0:1789762963.241575:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265678709726 time 265678803909 state 0x0 ref 1 00000100:00100000:2.0:1789762963.241604:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f75e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676352:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762963.241645:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.241661:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.241665:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.241672:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.241686:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.244567:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.244595:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.244605:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.244613:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff608200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762963.244617:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.244627:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.244644:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.244653:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b93f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762963.244709:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f75e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676352:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3116us (97958us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762963.244720:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 360 00000100:00100000:2.0:1789762963.244731:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265678709726 time 265678803909 state 0x2 ref 0 00000100:00100000:3.0:1789762963.247065:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762963.247121:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676480 00000100:00100000:1.0:1789762963.247131:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676480 00000100:00100000:1.0:1789762963.247183:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265678709726 time 265678803909 state 0x0 ref 1 00000100:00100000:1.0:1789762963.247197:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265778803909 time 265678803909 state 0x1 ref 1 00000004:00080000:0.0:1789762963.258877:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 265696123883ns, next at 266696121391ns, rc = 0 00000100:00100000:2.0:1789762963.258878:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789762963.258902:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254935680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762963.258949:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762963.258987:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935680 00000100:00100000:0.0:1789762963.258994:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935680 00000100:00080000:2.0:1789762963.259017:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762963.259039:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789762963.259048:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254935680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762963.259069:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3810422784 avail 3578900480 00000100:00100000:0.0:1789762963.259113:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254935680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762963.259119:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789762963.259155:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254935680:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789762963.260899:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000001:00080000:3.0:1789762963.260919:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000004:00080000:3.0:1789762963.260927:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000100:00100000:3.0:1789762963.260995:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c172a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254935808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789762963.261034:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762963.261080:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935808 00000100:00100000:2.0:1789762963.261087:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935808 00000100:00100000:2.0:1789762963.261123:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789762963.261133:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254935808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789762963.261151:0:12136:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:12 count 1 00002000:00010000:2.0:1789762963.261179:0:12136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 8388608, mtime: 0x6aad9d89, atime: 0x0, ctime: 0x6aad9d89, blocks: 0x4000 00010000:00010000:2.0:1789762963.261185:0:12136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.261198:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=265s v=(0 0) 00010000:00010000:2.0:1789762963.261202:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.261207:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.261217:0:12136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.261224:0:12136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.261229:0:12136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.261253:0:12136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762963.261271:0:8854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762963.261279:0:8854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.261287:0:8854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff608200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762963.261291:0:8854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.261299:0:8854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.261313:0:8854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.261329:0:8854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000123a39f4/0x5915dfb1c1b5b946 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.261349:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762963.261351:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762963.261355:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762963.261364:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254935808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 232us (329us total) trans 4294967741 rc 0/0 00000100:00100000:2.0:1789762963.261373:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000004:00080000:3.0:1789762963.261409:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b32c172a300/2, rc 0, transno 4294967741 00000100:00100000:3.0:1789762963.261416:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c172a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254935808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789762963.323033:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762963.341687:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265778803909 time 265778919121 state 0x0 ref 1 00000100:00100000:0.0:1789762963.341711:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676480:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762963.341746:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.341789:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762963.341798:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762963.341804:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.341817:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.344785:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.344797:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.344828:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.344836:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33fec90000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762963.344840:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.344851:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.344870:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.344880:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f32629/0x5915dfb1c1b5b94d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762963.344941:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676480:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3238us (97875us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762963.344951:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 361 00000100:00100000:0.0:1789762963.344960:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265778803909 time 265778919121 state 0x2 ref 0 00000100:00100000:3.0:1789762963.346924:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762963.346982:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676608 00000100:00100000:2.0:1789762963.346992:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676608 00000100:00100000:2.0:1789762963.347034:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265778803909 time 265778919121 state 0x0 ref 1 00000100:00100000:2.0:1789762963.347049:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265878919121 time 265778919121 state 0x1 ref 1 00000100:00100000:3.0:1789762963.441822:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265878919121 time 265879050944 state 0x0 ref 1 00000100:00100000:3.0:1789762963.441852:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676608:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762963.441892:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.441908:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.441913:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.441920:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.441935:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.445087:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.445107:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.445118:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.445127:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762963.445133:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.445145:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.445168:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.445177:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea4fd0a/0x5915dfb1c1b5b954 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762963.445287:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676608:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3444us (98361us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762963.445299:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 362 00000100:00100000:1.0:1789762963.445314:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265878919121 time 265879050944 state 0x2 ref 0 00000100:00100000:2.0:1789762963.447411:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762963.447463:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676736 00000100:00100000:3.0:1789762963.447471:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676736 00000100:00100000:3.0:1789762963.447510:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265878919121 time 265879050944 state 0x0 ref 1 00000100:00100000:3.0:1789762963.447521:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265979050944 time 265879050944 state 0x1 ref 1 00000100:00100000:3.0:1789762963.541904:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265979050944 time 265979135399 state 0x0 ref 1 00000100:00100000:3.0:1789762963.541930:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676736:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762963.541990:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.542005:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.542008:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.542013:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.542025:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.544633:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.544643:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.544649:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.544654:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762963.544657:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.544663:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.544686:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.544692:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b95b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762963.544739:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676736:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2820us (97333us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762963.544745:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 363 00000100:00100000:3.0:1789762963.544784:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265979050944 time 265979135399 state 0x2 ref 0 00000100:00100000:2.0:1789762963.546659:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762963.546708:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676864 00000100:00100000:0.0:1789762963.546717:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676864 00000100:00100000:0.0:1789762963.546787:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 265979050944 time 265979135399 state 0x0 ref 1 00000100:00100000:0.0:1789762963.546808:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266079135399 time 265979135399 state 0x1 ref 1 00000100:00100000:0.0:1789762963.642000:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266079135399 time 266079231469 state 0x0 ref 1 00000100:00100000:0.0:1789762963.642026:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676864:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762963.642062:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.642077:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789762963.642088:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762963.642093:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.642106:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.645215:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.645227:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.645235:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.645250:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c31e5e00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762963.645253:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.645260:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.645272:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762963.645277:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb28a59d/0x5915dfb1c1b5b962 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762963.645327:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246676864:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3311us (98668us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762963.645335:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 364 00000100:00100000:0.0:1789762963.645344:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266079135399 time 266079231469 state 0x2 ref 0 00000100:00100000:0.0:1789762963.647363:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762963.647479:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246676992 00000100:00100000:1.0:1789762963.647495:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246676992 00000100:00100000:1.0:1789762963.647569:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266079135399 time 266079231469 state 0x0 ref 1 00000100:00100000:1.0:1789762963.647587:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266179231469 time 266079231469 state 0x1 ref 1 00000100:00100000:1.0:1789762963.742144:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266179231469 time 266179363613 state 0x0 ref 1 00000100:00100000:1.0:1789762963.742185:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676992:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762963.742242:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.742264:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762963.742269:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762963.742277:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.742294:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.745480:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.745494:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.745505:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.745514:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762963.745519:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.745530:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.745553:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762963.745562:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b969 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762963.745632:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246676992:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3465us (98269us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762963.745644:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 365 00000100:00100000:1.0:1789762963.745664:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266179231469 time 266179363613 state 0x2 ref 0 00000100:00100000:2.0:1789762963.747568:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762963.747616:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246677120 00000100:00100000:3.0:1789762963.747626:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246677120 00000100:00100000:3.0:1789762963.747674:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266179231469 time 266179363613 state 0x0 ref 1 00000100:00100000:3.0:1789762963.747686:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266279363613 time 266179363613 state 0x1 ref 1 00000100:00100000:2.0:1789762963.842239:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266279363613 time 266279470316 state 0x0 ref 1 00000100:00100000:2.0:1789762963.842265:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246677120:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762963.842303:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.842317:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.842320:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762963.842325:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.842336:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.845026:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.845037:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.845044:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.845050:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c2f8ec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762963.845053:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.845059:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.845072:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762963.845077:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073b99d43/0x5915dfb1c1b5b970 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762963.845122:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246677120:12345-192.168.203.36@tcp:3:dd.0 Request processed in 2868us (97561us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762963.845130:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 366 00000100:00100000:2.0:1789762963.845144:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266279363613 time 266279470316 state 0x2 ref 0 00000100:00100000:2.0:1789762963.846963:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762963.847011:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246677248 00000100:00100000:0.0:1789762963.847020:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246677248 00000100:00100000:0.0:1789762963.847060:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266279363613 time 266279470316 state 0x0 ref 1 00000100:00100000:0.0:1789762963.847070:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266379470316 time 266279470316 state 0x1 ref 1 00000100:00100000:3.0:1789762963.942326:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266379470316 time 266379554028 state 0x0 ref 1 00000100:00100000:3.0:1789762963.942355:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246677248:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762963.942395:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.942412:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.942442:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762963.942450:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.942465:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.945193:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.945226:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.945236:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.945244:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762963.945249:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.945260:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.945278:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762963.945287:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b977 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762963.945354:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246677248:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3008us (98388us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762963.945365:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 367 00000100:00100000:3.0:1789762963.945375:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266379470316 time 266379554028 state 0x2 ref 0 00000100:00100000:0.0:1789762963.947240:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762963.947337:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246677376 00000100:00100000:1.0:1789762963.947353:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246677376 00000100:00100000:1.0:1789762963.947441:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266379470316 time 266379554028 state 0x0 ref 1 00000100:00100000:1.0:1789762963.947461:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266479554028 time 266379554028 state 0x1 ref 1 00000100:00100000:0.0:1789762964.042508:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266479554028 time 266479732224 state 0x0 ref 1 00000100:00100000:0.0:1789762964.042545:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246677376:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762964.042601:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.042624:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.042629:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.042637:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.042656:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.045833:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.045848:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.045858:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.045866:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c1a36a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762964.045872:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.045881:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.045903:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.045935:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbaff17/0x5915dfb1c1b5b97e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762964.046005:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246677376:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3477us (98763us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762964.046015:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 368 00000100:00100000:1.0:1789762964.046028:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266479554028 time 266479732224 state 0x2 ref 0 00000100:00100000:3.0:1789762964.047941:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762964.048005:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246677504 00000100:00100000:2.0:1789762964.048015:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246677504 00000100:00100000:2.0:1789762964.048073:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266479554028 time 266479732224 state 0x0 ref 1 00000100:00100000:2.0:1789762964.048089:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266579732224 time 266479732224 state 0x1 ref 1 00000100:00100000:2.0:1789762964.142580:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266579732224 time 266579813239 state 0x0 ref 1 00000100:00100000:2.0:1789762964.142609:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246677504:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762964.142650:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.142665:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.142669:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.142675:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.142688:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.146493:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.146519:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.146527:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.146533:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762964.146537:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.146546:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.146570:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.146577:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5b985 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762964.146648:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246677504:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4051us (98714us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762964.146659:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 369 00000100:00100000:2.0:1789762964.146669:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266579732224 time 266579813239 state 0x2 ref 0 00000100:00100000:2.0:1789762964.148591:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762964.149844:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246677632 00000100:00100000:2.0:1789762964.149852:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246677632 00000100:00100000:2.0:1789762964.149894:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266579732224 time 266579813239 state 0x0 ref 1 00000100:00100000:2.0:1789762964.149910:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266679813239 time 266579813239 state 0x1 ref 1 00000100:00100000:3.0:1789762964.242669:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266679813239 time 266679901621 state 0x0 ref 1 00000100:00100000:3.0:1789762964.242693:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246677632:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762964.242730:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.242745:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.242748:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.242770:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.242782:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.245780:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.245792:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.245810:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.245816:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762964.245819:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.245826:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.245839:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.245845:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b98c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.245893:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246677632:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3207us (97304us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.245903:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 370 00000100:00100000:3.0:1789762964.245914:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266679813239 time 266679901621 state 0x2 ref 0 00000100:00100000:3.0:1789762964.247879:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762964.247937:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246677760 00000100:00100000:1.0:1789762964.247952:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246677760 00000100:00100000:1.0:1789762964.248023:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266679813239 time 266679901621 state 0x0 ref 1 00000100:00100000:1.0:1789762964.248040:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266779901621 time 266679901621 state 0x1 ref 1 00000100:00100000:0.0:1789762964.342822:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266779901621 time 266780046518 state 0x0 ref 1 00000100:00100000:0.0:1789762964.342864:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246677760:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762964.342917:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.342936:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.342940:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762964.342946:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762964.342982:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.346617:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.346633:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.346640:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.346645:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b32c1a36200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762964.346649:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.346655:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.346670:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.346674:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063210423/0x5915dfb1c1b5b993 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762964.346790:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246677760:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3911us (98872us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762964.346802:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 371 00000100:00100000:2.0:1789762964.346813:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266779901621 time 266780046518 state 0x2 ref 0 00010000:00010000:1.0:1789762964.346908:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762964.348845:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762964.348902:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246677888 00000100:00100000:0.0:1789762964.348913:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246677888 00000100:00100000:0.0:1789762964.348961:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266779901621 time 266780046518 state 0x0 ref 1 00000100:00100000:0.0:1789762964.348973:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266880046518 time 266780046518 state 0x1 ref 1 00000100:00100000:2.0:1789762964.442964:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266880046518 time 266880194716 state 0x0 ref 1 00000100:00100000:2.0:1789762964.442990:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246677888:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762964.443040:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.443054:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.443058:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.443063:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.443076:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.446439:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.446455:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.446471:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.446477:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9af200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762964.446480:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.446487:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.446500:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.446506:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b99a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762964.446555:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246677888:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3575us (97709us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762964.446561:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 372 00000100:00100000:2.0:1789762964.446568:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266880046518 time 266880194716 state 0x2 ref 0 00000100:00100000:2.0:1789762964.448454:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762964.448498:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678016 00000100:00100000:3.0:1789762964.448508:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678016 00000100:00100000:3.0:1789762964.448550:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266880046518 time 266880194716 state 0x0 ref 1 00000100:00100000:3.0:1789762964.448572:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266980194716 time 266880194716 state 0x1 ref 1 00000100:00100000:2.0:1789762964.543036:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266980194716 time 266980268424 state 0x0 ref 1 00000100:00100000:2.0:1789762964.543065:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678016:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762964.543122:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.543136:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.543140:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.543148:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.543162:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.546643:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.546658:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.546668:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.546677:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9af200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762964.546682:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.546692:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.546710:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.546719:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da1fd43/0x5915dfb1c1b5b9a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.546819:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678016:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3764us (98362us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.546842:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 373 00000100:00100000:3.0:1789762964.546853:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266980194716 time 266980268424 state 0x2 ref 0 00000100:00100000:2.0:1789762964.548828:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762964.548883:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678144 00000100:00100000:0.0:1789762964.548896:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678144 00000100:00100000:0.0:1789762964.548962:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 266980194716 time 266980268424 state 0x0 ref 1 00000100:00100000:0.0:1789762964.548977:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267080268424 time 266980268424 state 0x1 ref 1 00000100:00100000:2.0:1789762964.643177:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267080268424 time 267080409314 state 0x0 ref 1 00000100:00100000:2.0:1789762964.643205:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678144:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762964.643243:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.643257:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762964.643261:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.643266:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.643279:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.646512:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.646523:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.646531:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.646536:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9af600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762964.646539:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.646545:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.646558:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.646617:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0b821ae/0x5915dfb1c1b5b9a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.646666:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678144:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3474us (97839us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.646683:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 374 00000100:00100000:3.0:1789762964.646692:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267080268424 time 267080409314 state 0x2 ref 0 00000100:00100000:0.0:1789762964.648938:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762964.648987:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678272 00000100:00100000:2.0:1789762964.648995:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678272 00000100:00100000:2.0:1789762964.649032:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267080268424 time 267080409314 state 0x0 ref 1 00000100:00100000:2.0:1789762964.649042:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267180409314 time 267080409314 state 0x1 ref 1 00000100:00100000:1.0:1789762964.743360:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267180409314 time 267180580415 state 0x0 ref 1 00000100:00100000:1.0:1789762964.743402:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678272:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762964.743474:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.743497:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762964.743502:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762964.743510:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.743546:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.747344:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.747358:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.747368:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.747377:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762964.747382:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.747394:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.747417:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762964.747441:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9af lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762964.747522:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678272:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4139us (98589us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762964.747534:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 375 00000100:00100000:1.0:1789762964.747547:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267180409314 time 267180580415 state 0x2 ref 0 00000100:00100000:0.0:1789762964.749835:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762964.749880:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678400 00000100:00100000:3.0:1789762964.749893:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678400 00000100:00100000:3.0:1789762964.749942:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267180409314 time 267180580415 state 0x0 ref 1 00000100:00100000:3.0:1789762964.749955:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267280580415 time 267180580415 state 0x1 ref 1 00000100:00100000:2.0:1789762964.843506:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267280580415 time 267280737103 state 0x0 ref 1 00000100:00100000:2.0:1789762964.843532:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678400:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762964.843569:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.843584:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.843587:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762964.843592:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.843602:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.847131:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.847141:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.847156:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.847162:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff58b800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762964.847165:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.847172:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.847191:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762964.847197:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e9ae7c7/0x5915dfb1c1b5b9b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762964.847243:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678400:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3722us (97409us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762964.847249:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 376 00000100:00100000:2.0:1789762964.847257:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267280580415 time 267280737103 state 0x2 ref 0 00000100:00100000:2.0:1789762964.849748:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762964.849801:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678528 00000100:00100000:3.0:1789762964.849809:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678528 00000100:00100000:3.0:1789762964.849845:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267280580415 time 267280737103 state 0x0 ref 1 00000100:00100000:3.0:1789762964.849856:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267380737103 time 267280737103 state 0x1 ref 1 00000100:00100000:3.0:1789762964.943605:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267380737103 time 267380837436 state 0x0 ref 1 00000100:00100000:3.0:1789762964.943632:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678528:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762964.943668:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.943683:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.943686:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762964.943691:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.943719:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.946723:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.946738:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.946766:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.946776:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762964.946781:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.946792:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.946810:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762964.946819:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762964.946881:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678528:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3261us (97133us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762964.946888:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 377 00000100:00100000:3.0:1789762964.946896:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267380737103 time 267380837436 state 0x2 ref 0 00000100:00100000:2.0:1789762964.949107:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762964.949182:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678656 00000100:00100000:1.0:1789762964.949198:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678656 00000100:00100000:1.0:1789762964.949268:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267380737103 time 267380837436 state 0x0 ref 1 00000100:00100000:1.0:1789762964.949286:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267480837436 time 267380837436 state 0x1 ref 1 00000100:00100000:0.0:1789762965.043792:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267480837436 time 267480987251 state 0x0 ref 1 00000100:00100000:0.0:1789762965.043828:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678656:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762965.043865:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789762965.043881:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789762965.043886:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762965.043905:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762965.043913:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.043929:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.047096:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.047111:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.047119:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.047125:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff9afa00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762965.047130:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.047140:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.047159:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.047168:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042f18eaa/0x5915dfb1c1b5b9c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762965.047229:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678656:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3421us (98123us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762965.047237:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 378 00000100:00100000:0.0:1789762965.047244:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267480837436 time 267480987251 state 0x2 ref 0 00000100:00100000:0.0:1789762965.049522:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762965.049583:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678784 00000100:00100000:2.0:1789762965.049598:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678784 00000100:00100000:2.0:1789762965.049644:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267480837436 time 267480987251 state 0x0 ref 1 00000100:00100000:2.0:1789762965.049659:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267580987251 time 267480987251 state 0x1 ref 1 00000100:00100000:2.0:1789762965.143875:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267580987251 time 267581102948 state 0x0 ref 1 00000100:00100000:2.0:1789762965.143907:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678784:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762965.143943:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.143958:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762965.143962:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762965.143967:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.143977:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.147336:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.147349:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.147359:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.147379:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f757d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762965.147384:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.147394:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.147410:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.147432:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5b9cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762965.147489:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246678784:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3593us (97967us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762965.147500:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 379 00000100:00100000:2.0:1789762965.147511:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267580987251 time 267581102948 state 0x2 ref 0 00000100:00100000:2.0:1789762965.149603:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762965.149642:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246678912 00000100:00100000:3.0:1789762965.149650:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246678912 00000100:00100000:3.0:1789762965.149684:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267580987251 time 267581102948 state 0x0 ref 1 00000100:00100000:3.0:1789762965.149695:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267681102948 time 267581102948 state 0x1 ref 1 00000100:00100000:3.0:1789762965.243927:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267681102948 time 267681158205 state 0x0 ref 1 00000100:00100000:3.0:1789762965.243953:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678912:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762965.243993:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.244008:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.244011:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.244016:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.244027:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.247476:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.247486:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.247494:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.247499:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762965.247502:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.247509:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.247521:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.247526:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762965.247573:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246678912:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3630us (97970us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762965.247580:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 380 00000100:00100000:3.0:1789762965.247594:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267681102948 time 267681158205 state 0x2 ref 0 00000100:00100000:0.0:1789762965.249562:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762965.249605:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679040 00000100:00100000:2.0:1789762965.249613:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679040 00000100:00100000:2.0:1789762965.249649:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267681102948 time 267681158205 state 0x0 ref 1 00000100:00100000:2.0:1789762965.249659:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267781158205 time 267681158205 state 0x1 ref 1 00000100:00100000:3.0:1789762965.344010:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267781158205 time 267781242355 state 0x0 ref 1 00000100:00100000:3.0:1789762965.344035:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679040:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762965.344072:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.344087:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.344090:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.344095:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.344106:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.347052:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.347072:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.347086:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.347095:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762965.347111:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.347122:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.347138:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.347143:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762965.347191:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679040:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3166us (97630us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762965.347198:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 381 00000100:00100000:3.0:1789762965.347205:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267781158205 time 267781242355 state 0x2 ref 0 00000100:00100000:2.0:1789762965.349117:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762965.349174:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679168 00000100:00100000:1.0:1789762965.349189:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679168 00000100:00100000:1.0:1789762965.349254:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267781158205 time 267781242355 state 0x0 ref 1 00000100:00100000:1.0:1789762965.349268:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267881242355 time 267781242355 state 0x1 ref 1 00010000:00010000:1.0:1789762965.370881:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762965.444099:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267881242355 time 267881325265 state 0x0 ref 1 00000100:00100000:1.0:1789762965.444132:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679168:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762965.444180:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.444219:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762965.444223:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762965.444229:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.444243:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.447781:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.447792:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.447799:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.447804:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762965.447808:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.447814:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.447830:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.447848:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762965.447920:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679168:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3803us (98803us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762965.447930:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 382 00000100:00100000:1.0:1789762965.447939:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267881242355 time 267881325265 state 0x2 ref 0 00000100:00100000:0.0:1789762965.449803:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762965.449848:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679296 00000100:00100000:3.0:1789762965.449858:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679296 00000100:00100000:3.0:1789762965.449908:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267881242355 time 267881325265 state 0x0 ref 1 00000100:00100000:3.0:1789762965.449920:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267981325265 time 267881325265 state 0x1 ref 1 00000100:00100000:0.0:1789762965.544225:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267981325265 time 267981444740 state 0x0 ref 1 00000100:00100000:0.0:1789762965.544266:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679296:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762965.544322:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.544345:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762965.544351:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762965.544360:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.544379:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.548258:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.548274:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.548282:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.548288:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762965.548291:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.548298:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.548312:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.548317:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc302c5f/0x5915dfb1c1b5b9e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762965.548391:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679296:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4141us (98593us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762965.548401:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 383 00000100:00100000:2.0:1789762965.548449:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267981325265 time 267981444740 state 0x2 ref 0 00000100:00100000:2.0:1789762965.550345:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762965.550386:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679424 00000100:00100000:3.0:1789762965.550395:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679424 00000100:00100000:3.0:1789762965.550450:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 267981325265 time 267981444740 state 0x0 ref 1 00000100:00100000:3.0:1789762965.550471:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268081444740 time 267981444740 state 0x1 ref 1 00000100:00100000:3.0:1789762965.644256:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268081444740 time 268081488150 state 0x0 ref 1 00000100:00100000:3.0:1789762965.644283:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679424:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762965.644331:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.644345:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789762965.644348:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.644353:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.644366:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.648239:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.648250:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.648258:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.648276:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762965.648279:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.648286:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.648299:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.648304:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5b9ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762965.648354:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679424:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4082us (98010us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762965.648361:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 384 00000100:00100000:3.0:1789762965.648370:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268081444740 time 268081488150 state 0x2 ref 0 00000100:00100000:2.0:1789762965.650376:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762965.650463:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679552 00000100:00100000:1.0:1789762965.650480:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679552 00000100:00100000:1.0:1789762965.650546:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268081444740 time 268081488150 state 0x0 ref 1 00000100:00100000:1.0:1789762965.650562:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268181488150 time 268081488150 state 0x1 ref 1 00000100:00100000:2.0:1789762965.744459:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268181488150 time 268181690035 state 0x0 ref 1 00000100:00100000:2.0:1789762965.744486:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679552:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762965.744523:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.744537:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762965.744541:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762965.744545:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762965.744557:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.749231:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.749279:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.749293:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.749303:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762965.749310:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.749322:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.749350:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762965.749359:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553be900/0x5915dfb1c1b5b9f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762965.749516:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679552:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5033us (99132us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762965.749533:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 385 00000100:00100000:0.0:1789762965.749550:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268181488150 time 268181690035 state 0x2 ref 0 00000100:00100000:0.0:1789762965.751906:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762965.751998:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679680 00000100:00100000:2.0:1789762965.752010:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679680 00000100:00100000:2.0:1789762965.752063:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268181488150 time 268181690035 state 0x0 ref 1 00000100:00100000:2.0:1789762965.752079:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268281690035 time 268181690035 state 0x1 ref 1 00000100:00100000:1.0:1789762965.844589:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268281690035 time 268281821162 state 0x0 ref 1 00000100:00100000:1.0:1789762965.844614:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679680:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762965.844659:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.844677:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762965.844681:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762965.844685:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.844714:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.848971:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.848979:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.848985:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.848990:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762965.848994:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.849001:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.849014:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762965.849019:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5b9fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762965.849078:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679680:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4473us (97177us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762965.849086:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 386 00000100:00100000:1.0:1789762965.849094:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268281690035 time 268281821162 state 0x2 ref 0 00000100:00100000:0.0:1789762965.851543:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762965.851632:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679808 00000100:00100000:3.0:1789762965.851649:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679808 00000100:00100000:3.0:1789762965.851729:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268281690035 time 268281821162 state 0x0 ref 1 00000100:00100000:3.0:1789762965.851796:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268381821162 time 268281821162 state 0x1 ref 1 00000100:00100000:3.0:1789762965.944715:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268381821162 time 268381932942 state 0x0 ref 1 00000100:00100000:3.0:1789762965.944813:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679808:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762965.944880:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.944938:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.944945:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762965.944955:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.944977:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.950572:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.950594:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.950607:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.950617:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762965.950623:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.950635:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.950676:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762965.950687:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762965.950828:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246679808:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6029us (99292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762965.950844:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 387 00000100:00100000:3.0:1789762965.950859:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268381821162 time 268381932942 state 0x2 ref 0 00000100:00100000:2.0:1789762965.953662:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762965.953809:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246679936 00000100:00100000:0.0:1789762965.953829:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246679936 00000100:00100000:0.0:1789762965.953904:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268381821162 time 268381932942 state 0x0 ref 1 00000100:00100000:0.0:1789762965.953934:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268481932942 time 268381932942 state 0x1 ref 1 00000100:00100000:3.0:1789762966.044884:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268481932942 time 268482103948 state 0x0 ref 1 00000100:00100000:3.0:1789762966.044925:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679936:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762966.044986:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.045008:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.045013:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.045021:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.045038:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.050018:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.050034:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.050044:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.050050:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762966.050065:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.050075:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.050092:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.050099:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762966.050175:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246679936:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5267us (96516us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762966.050185:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 388 00000100:00100000:3.0:1789762966.050208:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268481932942 time 268482103948 state 0x2 ref 0 00000100:00100000:0.0:1789762966.052926:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762966.053001:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680064 00000100:00100000:1.0:1789762966.053014:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680064 00000100:00100000:1.0:1789762966.053068:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268481932942 time 268482103948 state 0x0 ref 1 00000100:00100000:1.0:1789762966.053084:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268582103948 time 268482103948 state 0x1 ref 1 00000100:00100000:3.0:1789762966.145127:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268582103948 time 268582333748 state 0x0 ref 1 00000100:00100000:3.0:1789762966.145181:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246680064:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762966.145263:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.145299:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.145308:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.145322:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.145350:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.152147:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.152173:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.152188:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.152198:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762966.152226:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.152241:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.152265:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.152276:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762966.152360:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246680064:12345-192.168.203.36@tcp:3:dd.0 Request processed in 7201us (99433us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762966.152373:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 389 00000100:00100000:3.0:1789762966.152389:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268582103948 time 268582333748 state 0x2 ref 0 00000100:00100000:0.0:1789762966.155846:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762966.155923:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680192 00000100:00100000:3.0:1789762966.155941:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680192 00000100:00100000:3.0:1789762966.156022:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268582103948 time 268582333748 state 0x0 ref 1 00000100:00100000:3.0:1789762966.156051:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268682333748 time 268582333748 state 0x1 ref 1 00000100:00100000:2.0:1789762966.245320:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268682333748 time 268682522590 state 0x0 ref 1 00000100:00100000:2.0:1789762966.245385:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246680192:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762966.245474:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.245498:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762966.245505:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762966.245513:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.245532:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.250832:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.250850:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.250860:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.250868:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762966.250874:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.250884:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.250906:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.250930:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5ba18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762966.251011:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246680192:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5639us (95169us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762966.251022:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 390 00000100:00100000:0.0:1789762966.251053:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268682333748 time 268682522590 state 0x2 ref 0 00000100:00100000:0.0:1789762966.254328:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762966.254395:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680320 00000100:00100000:3.0:1789762966.254426:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680320 00000100:00100000:3.0:1789762966.254515:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268682333748 time 268682522590 state 0x0 ref 1 00000100:00100000:3.0:1789762966.254569:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268782522590 time 268682522590 state 0x1 ref 1 00000100:00100000:0.0:1789762966.331104:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254936192:0@lo:400:kworker.0 00000100:00100000:3.0:1789762966.331132:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254936064:0@lo:400:kworker.0 00000100:00100000:2.0:1789762966.331137:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254935936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789762966.331165:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254936320:0@lo:400:kworker.0 00000100:00100000:0.0:1789762966.331249:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762966.331266:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762966.331266:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762966.331323:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936192 00000100:00100000:1.0:1789762966.331335:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936192 00000100:00100000:3.0:1789762966.331363:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254936448:0@lo:400:kworker.0 00000100:00100000:0.0:1789762966.331368:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254936704:0@lo:400:kworker.0 00000100:00100000:2.0:1789762966.331370:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254936576:0@lo:400:kworker.0 00000100:00100000:1.0:1789762966.331430:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789762966.331449:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762966.331452:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254936192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762966.331494:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762966.331503:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762966.331543:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936448 00000100:00100000:3.0:1789762966.331552:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936448 00000100:00100000:1.0:1789762966.331566:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254936192:12345-0@lo:400:kworker.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762966.331579:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789762966.331587:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254936192:0@lo:400:kworker.0 00000100:00100000:2.0:1789762966.331590:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254935936 00000100:00100000:2.0:1789762966.331599:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254935936 00000100:00100000:1.0:1789762966.331636:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936576 00000100:00100000:3.0:1789762966.331647:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936704 00000100:00100000:1.0:1789762966.331650:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936576 00000100:00100000:3.0:1789762966.331658:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936704 00000100:00100000:0.0:1789762966.331689:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789762966.331707:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789762966.331727:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254936448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762966.331741:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254935936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762966.331742:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789762966.331773:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789762966.331841:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254936576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762966.331850:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254936704:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789762966.331892:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33784384 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762966.331913:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254936448:12345-0@lo:400:kworker.0 Request processed in 206us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762966.331927:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789762966.331971:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254936576:12345-0@lo:400:kworker.0 Request processed in 182us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762966.331985:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3418:x1876702254936704:12345-0@lo:400:kworker.0 Request processed in 221us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762966.332004:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789762966.332010:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254936704:0@lo:400:kworker.0 00000100:00100000:1.0:1789762966.332017:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789762966.332019:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1876702254935936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762966.332043:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789762966.332094:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762966.332096:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936064 00000100:00080000:3.0:1789762966.332121:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762966.332124:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936064 00000100:00080000:3.0:1789762966.332129:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762966.332157:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254935936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762966.332181:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254936448:0@lo:400:kworker.0 00000100:00100000:0.0:1789762966.332192:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762966.332198:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789762966.332203:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254936576:0@lo:400:kworker.0 00000100:00100000:1.0:1789762966.332220:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254936064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762966.332284:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936320 00000100:00100000:3.0:1789762966.332294:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936320 00000100:00100000:1.0:1789762966.332296:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3420:x1876702254936064:12345-0@lo:400:kworker.0 Request processed in 82us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762966.332309:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789762966.332319:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3420:1876702254936064:0@lo:400:kworker.0 00000100:00080000:2.0:1789762966.332373:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762966.332373:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789762966.332394:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254936320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762966.332479:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1876702254936320:12345-0@lo:400:kworker.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762966.332501:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789762966.332532:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1876702254936320:0@lo:400:kworker.0 00000100:00100000:0.0:1789762966.345396:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268782522590 time 268782626753 state 0x0 ref 1 00000100:00100000:0.0:1789762966.345452:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246680320:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762966.345502:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.345526:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762966.345532:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762966.345540:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.345558:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.351744:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.351788:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.351798:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.351807:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762966.351813:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.351862:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.351888:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.351900:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762966.351979:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246680320:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6541us (97649us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762966.351992:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 391 00000100:00100000:0.0:1789762966.352005:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268782522590 time 268782626753 state 0x2 ref 0 00000100:00100000:0.0:1789762966.355463:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762966.355531:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680448 00000100:00100000:3.0:1789762966.355541:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680448 00000100:00100000:3.0:1789762966.355591:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268782522590 time 268782626753 state 0x0 ref 1 00000100:00100000:3.0:1789762966.355627:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268882626753 time 268782626753 state 0x1 ref 1 00010000:00010000:0.0:1789762966.394942:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762966.445474:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268882626753 time 268882702968 state 0x0 ref 1 00000100:00100000:0.0:1789762966.445499:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246680448:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762966.445544:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.445561:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762966.445565:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762966.445586:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.445599:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.449052:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.449067:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.449079:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.449088:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762966.449094:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.449103:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.449119:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.449124:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae74722/0x5915dfb1c1b5ba26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762966.449180:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246680448:12345-192.168.203.36@tcp:3:dd.0 Request processed in 3691us (93723us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762966.449196:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 392 00000100:00100000:2.0:1789762966.449206:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268882626753 time 268882702968 state 0x2 ref 0 00000100:00100000:2.0:1789762966.451305:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762966.451350:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680576 00000100:00100000:0.0:1789762966.451359:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680576 00000100:00100000:0.0:1789762966.451401:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268882626753 time 268882702968 state 0x0 ref 1 00000100:00100000:0.0:1789762966.451429:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268982702968 time 268882702968 state 0x1 ref 1 00000100:00100000:1.0:1789762966.545573:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268982702968 time 268982797627 state 0x0 ref 1 00000100:00100000:1.0:1789762966.545600:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246680576:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762966.545650:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.545668:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762966.545672:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762966.545678:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.545692:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.550556:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.550569:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.550584:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.550591:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762966.550595:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.550602:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.550617:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762966.550622:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762966.550689:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2353:x1876702246680576:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5096us (99381us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762966.550701:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 393 00000100:00100000:1.0:1789762966.550711:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268982702968 time 268982797627 state 0x2 ref 0 00000100:00100000:2.0:1789762966.553723:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762966.553854:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680704 00000100:00100000:0.0:1789762966.553865:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680704 00000100:00100000:0.0:1789762966.553949:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 268982702968 time 268982797627 state 0x0 ref 1 00000100:00100000:0.0:1789762966.553966:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269082797627 time 268982797627 state 0x1 ref 1 00000100:00100000:2.0:1789762966.645727:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269082797627 time 269082948906 state 0x0 ref 1 00000100:00100000:2.0:1789762966.645786:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246680704:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762966.645849:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.645870:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762966.645875:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762966.645881:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.645899:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.650062:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.650077:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.650086:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.650092:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f757d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762966.650097:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.650105:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.650122:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.650141:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b86202f/0x5915dfb1c1b5ba34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762966.650211:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246680704:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4462us (96494us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762966.650224:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 394 00000100:00100000:3.0:1789762966.650237:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269082797627 time 269082948906 state 0x2 ref 0 00000100:00100000:0.0:1789762966.652920:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762966.652982:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680832 00000100:00100000:2.0:1789762966.652994:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680832 00000100:00100000:2.0:1789762966.653052:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269082797627 time 269082948906 state 0x0 ref 1 00000100:00100000:2.0:1789762966.653074:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269182948906 time 269082948906 state 0x1 ref 1 00000100:00100000:3.0:1789762966.745944:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269182948906 time 269183161949 state 0x0 ref 1 00000100:00100000:3.0:1789762966.745993:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246680832:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762966.746087:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.746118:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.746125:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.746134:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.746154:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.750799:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.750819:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.750832:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.750842:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762966.750849:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.750862:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.750884:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762966.750893:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0986d67/0x5915dfb1c1b5ba3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762966.750985:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246680832:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5014us (98065us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762966.750998:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 395 00000100:00100000:2.0:1789762966.751012:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269182948906 time 269183161949 state 0x2 ref 0 00000100:00100000:3.0:1789762966.754622:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762966.754744:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246680960 00000100:00100000:1.0:1789762966.754823:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246680960 00000100:00100000:1.0:1789762966.754882:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269182948906 time 269183161949 state 0x0 ref 1 00000100:00100000:1.0:1789762966.754912:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269283161949 time 269183161949 state 0x1 ref 1 00000100:00100000:3.0:1789762966.846129:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269283161949 time 269283355580 state 0x0 ref 1 00000100:00100000:3.0:1789762966.846175:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246680960:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762966.846220:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.846240:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.846246:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762966.846254:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.846270:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.850712:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.850731:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.850740:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.850777:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762966.850781:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.850788:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.850815:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762966.850820:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d6f8aa/0x5915dfb1c1b5ba42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762966.850895:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246680960:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4726us (96275us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762966.850903:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 396 00000100:00100000:3.0:1789762966.850913:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269283161949 time 269283355580 state 0x2 ref 0 00000100:00100000:3.0:1789762966.853892:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762966.853971:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681088 00000100:00100000:2.0:1789762966.853985:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681088 00000100:00100000:2.0:1789762966.854047:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269283161949 time 269283355580 state 0x0 ref 1 00000100:00100000:2.0:1789762966.854073:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269383355580 time 269283355580 state 0x1 ref 1 00000100:00100000:0.0:1789762966.915885:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762966.915959:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762966.915989:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681344 00000100:00100000:2.0:1789762966.916002:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681344 00000100:00100000:0.0:1789762966.916004:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762966.916044:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681216 00000100:00100000:3.0:1789762966.916059:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681216 00000100:00100000:0.0:1789762966.916081:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762966.916102:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681600 00000100:00100000:1.0:1789762966.916115:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681600 00000100:00100000:0.0:1789762966.916167:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:3.0:1789762966.916168:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 279 00000100:00100000:2.0:1789762966.916215:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:0.0:1789762966.916230:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246681344:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762966.916232:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246681216:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762966.916251:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246681600:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762966.916311:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681472 00000100:00100000:1.0:1789762966.916320:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681472 00000100:00100000:3.0:1789762966.916365:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246681216:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762966.916372:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:2356:x1876702246681344:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 152us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762966.916377:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2356:x1876702246681600:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 126us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762966.916398:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 279 00000100:00100000:1.0:1789762966.916399:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:2.0:1789762966.916433:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:0.0:1789762966.916457:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:1.0:1789762966.916458:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246681472:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:3.0:1789762966.916490:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762966.916501:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762966.916539:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246681472:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 95us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762966.916550:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:0.0:1789762966.946236:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269383355580 time 269383464665 state 0x0 ref 1 00000100:00100000:0.0:1789762966.946272:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246681088:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762966.946322:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.946350:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762966.946356:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762966.946364:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.946383:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.950913:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.950930:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.950942:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.950951:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff58f600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762966.950971:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.950984:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.951006:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762966.951016:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762966.951096:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246681088:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4832us (97198us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762966.951116:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 397 00000100:00100000:0.0:1789762966.951134:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269383355580 time 269383464665 state 0x2 ref 0 00000100:00100000:2.0:1789762966.953834:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762966.953898:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681728 00000100:00100000:3.0:1789762966.953910:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681728 00000100:00100000:3.0:1789762966.953961:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269383355580 time 269383464665 state 0x0 ref 1 00000100:00100000:3.0:1789762966.953987:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269483464665 time 269383464665 state 0x1 ref 1 00000100:00100000:1.0:1789762967.046424:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269483464665 time 269483615610 state 0x0 ref 1 00000100:00100000:1.0:1789762967.046521:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246681728:12345-192.168.203.36@tcp:3:dd.0 00000100:00080000:3.0:1789762967.046557:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789762967.046594:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.046629:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.046639:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.046652:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.046679:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.055100:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.055126:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.055140:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.055149:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762967.055157:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.055169:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.055196:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.055206:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762967.055321:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246681728:12345-192.168.203.36@tcp:3:dd.0 Request processed in 8862us (101483us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762967.055338:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 398 00000100:00100000:1.0:1789762967.055370:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269483464665 time 269483615610 state 0x2 ref 0 00000100:00100000:3.0:1789762967.058610:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762967.058692:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681856 00000100:00100000:2.0:1789762967.058710:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681856 00000100:00100000:2.0:1789762967.058819:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269483464665 time 269483615610 state 0x0 ref 1 00000100:00100000:2.0:1789762967.058841:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269583615610 time 269483615610 state 0x1 ref 1 00000100:00100000:0.0:1789762967.146640:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269583615610 time 269583854285 state 0x0 ref 1 00000100:00100000:0.0:1789762967.146685:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246681856:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762967.146800:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.146835:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762967.146844:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762967.146858:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.146914:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.152103:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.152123:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.152137:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.152147:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff58f600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762967.152154:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.152166:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.152189:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.152198:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bae4c8a2/0x5915dfb1c1b5ba57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762967.152311:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246681856:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5642us (93702us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762967.152325:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 399 00000100:00100000:0.0:1789762967.152339:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269583615610 time 269583854285 state 0x2 ref 0 00000100:00100000:2.0:1789762967.155785:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762967.155834:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246681984 00000100:00100000:0.0:1789762967.155849:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246681984 00000100:00100000:0.0:1789762967.155910:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269583615610 time 269583854285 state 0x0 ref 1 00000100:00100000:0.0:1789762967.155929:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269683854285 time 269583854285 state 0x1 ref 1 00000100:00100000:1.0:1789762967.246838:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269683854285 time 269684058344 state 0x0 ref 1 00000100:00100000:1.0:1789762967.246879:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246681984:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762967.246935:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.246959:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.246965:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.246974:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.246993:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.252826:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.252847:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.252880:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.252901:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c13eea00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762967.252908:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.252921:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.252944:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.252954:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc732166/0x5915dfb1c1b5ba5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762967.253040:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f463c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246681984:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6176us (97288us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762967.253053:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 400 00000100:00100000:2.0:1789762967.253067:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269683854285 time 269684058344 state 0x2 ref 0 00000100:00100000:2.0:1789762967.256468:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762967.256560:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246682112 00000100:00100000:1.0:1789762967.256575:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246682112 00000100:00100000:1.0:1789762967.256639:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269683854285 time 269684058344 state 0x0 ref 1 00000100:00100000:1.0:1789762967.256659:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269784058344 time 269684058344 state 0x1 ref 1 00000100:00100000:3.0:1789762967.347021:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269784058344 time 269784245879 state 0x0 ref 1 00000100:00100000:3.0:1789762967.347062:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246682112:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762967.347124:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.347154:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762967.347162:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762967.347174:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.347199:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.352218:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.352239:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.352251:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.352280:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff813200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762967.352287:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.352299:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.352321:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.352332:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762967.352433:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246682112:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5386us (95966us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762967.352446:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 401 00000100:00100000:3.0:1789762967.352460:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269784058344 time 269784245879 state 0x2 ref 0 00000100:00100000:3.0:1789762967.355811:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762967.355946:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246682240 00000100:00100000:0.0:1789762967.355962:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246682240 00000100:00100000:0.0:1789762967.356025:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269784058344 time 269784245879 state 0x0 ref 1 00000100:00100000:0.0:1789762967.356044:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269884245879 time 269784245879 state 0x1 ref 1 00010000:00010000:0.0:1789762967.418978:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762967.447143:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269884245879 time 269884367721 state 0x0 ref 1 00000100:00100000:3.0:1789762967.447178:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246682240:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762967.447228:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.447275:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762967.447281:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762967.447289:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.447321:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.453337:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.453358:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.453370:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.453379:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff813200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762967.453385:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.453397:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.453451:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.453495:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762967.453591:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246682240:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6423us (97781us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762967.453603:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 402 00000100:00100000:3.0:1789762967.453616:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269884245879 time 269884367721 state 0x2 ref 0 00000100:00100000:3.0:1789762967.456950:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762967.457093:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246682368 00000100:00100000:2.0:1789762967.457112:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246682368 00000100:00100000:2.0:1789762967.457190:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269884245879 time 269884367721 state 0x0 ref 1 00000100:00100000:2.0:1789762967.457236:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269984367721 time 269884367721 state 0x1 ref 1 00000100:00100000:2.0:1789762967.547207:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269984367721 time 269984430532 state 0x0 ref 1 00000100:00100000:2.0:1789762967.547239:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c211d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246682368:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762967.547290:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.547312:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762967.547318:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762967.547326:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.547344:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.554083:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.554118:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.554139:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.554155:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f757c800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762967.554164:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.554185:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.554259:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762967.554278:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5dd00c7/0x5915dfb1c1b5ba73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762967.554445:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c211d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246682368:12345-192.168.203.36@tcp:3:dd.0 Request processed in 7209us (97491us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762967.554468:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 403 00000100:00100000:3.0:1789762967.554491:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269984367721 time 269984430532 state 0x2 ref 0 00000100:00100000:3.0:1789762967.557999:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762967.558092:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246682496 00000100:00100000:2.0:1789762967.558109:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246682496 00000100:00100000:2.0:1789762967.558178:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 269984367721 time 269984430532 state 0x0 ref 1 00000100:00100000:2.0:1789762967.558198:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270084430532 time 269984430532 state 0x1 ref 1 00000100:00100000:2.0:1789762967.647306:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270084430532 time 270084528081 state 0x0 ref 1 00000100:00100000:2.0:1789762967.647339:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246682496:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762967.647442:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.647466:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789762967.647473:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762967.647483:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.647505:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.653050:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.653076:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.653095:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.653112:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f757dc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762967.653122:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.653141:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.653186:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762967.653198:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df812e3f/0x5915dfb1c1b5ba7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762967.653282:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246682496:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5953us (95286us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762967.653294:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 404 00000100:00100000:2.0:1789762967.653306:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270084430532 time 270084528081 state 0x2 ref 0 00000100:00100000:3.0:1789762967.656836:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762967.656896:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246682624 00000100:00100000:2.0:1789762967.656910:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246682624 00000100:00100000:2.0:1789762967.656967:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270084430532 time 270084528081 state 0x0 ref 1 00000100:00100000:2.0:1789762967.656986:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270184528081 time 270084528081 state 0x1 ref 1 00000100:00100000:1.0:1789762967.747512:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270184528081 time 270184729016 state 0x0 ref 1 00000100:00100000:1.0:1789762967.747567:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246682624:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762967.747673:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.747701:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.747708:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.747716:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.747737:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.754313:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.754350:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.754365:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.754374:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54a800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762967.754381:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.754393:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.754465:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.754476:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762967.754565:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246682624:12345-192.168.203.36@tcp:3:dd.0 Request processed in 7023us (97732us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762967.754578:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 405 00000100:00100000:1.0:1789762967.754592:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270184528081 time 270184729016 state 0x2 ref 0 00000100:00100000:3.0:1789762967.758582:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762967.758663:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246682752 00000100:00100000:2.0:1789762967.758679:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246682752 00000100:00100000:2.0:1789762967.758817:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270184528081 time 270184729016 state 0x0 ref 1 00000100:00100000:2.0:1789762967.758845:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270284729016 time 270184729016 state 0x1 ref 1 00000100:00100000:0.0:1789762967.847682:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270284729016 time 270284905367 state 0x0 ref 1 00000100:00100000:0.0:1789762967.847716:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246682752:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762967.847799:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.847846:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762967.847852:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762967.847860:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.847878:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.853142:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.853162:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.853175:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.853184:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b34021f7a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762967.853191:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.853203:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.853224:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762967.853254:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c0e9b27/0x5915dfb1c1b5ba88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762967.853345:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246682752:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5639us (94764us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762967.853357:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 406 00000100:00100000:0.0:1789762967.853371:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270284729016 time 270284905367 state 0x2 ref 0 00000100:00100000:3.0:1789762967.856509:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762967.856593:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246682880 00000100:00100000:2.0:1789762967.856607:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246682880 00000100:00100000:2.0:1789762967.856678:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270284729016 time 270284905367 state 0x0 ref 1 00000100:00100000:2.0:1789762967.856697:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270384905367 time 270284905367 state 0x1 ref 1 00000100:00100000:1.0:1789762967.947864:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270384905367 time 270385061762 state 0x0 ref 1 00000100:00100000:1.0:1789762967.947923:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246682880:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:1.0:1789762967.947985:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.948015:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.948024:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762967.948037:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.948064:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.954285:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.954307:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.954322:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.954334:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54a800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762967.954342:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.954360:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.954389:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762967.954433:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007286acda/0x5915dfb1c1b5ba8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762967.954527:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246682880:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6621us (98019us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789762967.954544:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 407 00000100:00100000:1.0:1789762967.954574:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270384905367 time 270385061762 state 0x2 ref 0 00000100:00100000:3.0:1789762967.957954:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762967.958030:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683008 00000100:00100000:1.0:1789762967.958045:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683008 00000100:00100000:1.0:1789762967.958118:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270384905367 time 270385061762 state 0x0 ref 1 00000100:00100000:1.0:1789762967.958140:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270485061762 time 270385061762 state 0x1 ref 1 00000100:00100000:3.0:1789762968.048012:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270485061762 time 270485230245 state 0x0 ref 1 00000100:00100000:3.0:1789762968.048055:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246683008:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762968.048120:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.048145:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762968.048152:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762968.048179:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.048197:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.053531:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.053550:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.053562:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.053570:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff813200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762968.053576:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.053586:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.053607:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.053615:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762968.053715:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246683008:12345-192.168.203.36@tcp:3:dd.0 Request processed in 5678us (95764us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762968.053726:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 408 00000100:00100000:3.0:1789762968.053738:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270485061762 time 270485230245 state 0x2 ref 0 00000100:00100000:3.0:1789762968.056562:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762968.056644:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683136 00000100:00100000:0.0:1789762968.056675:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683136 00000100:00100000:0.0:1789762968.056797:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270485061762 time 270485230245 state 0x0 ref 1 00000100:00100000:0.0:1789762968.056818:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270585230245 time 270485230245 state 0x1 ref 1 00000100:00100000:3.0:1789762968.148134:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270585230245 time 270585357974 state 0x0 ref 1 00000100:00100000:3.0:1789762968.148164:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246683136:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:3.0:1789762968.148213:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.148234:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762968.148241:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762968.148249:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.148267:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.154081:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.154099:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.154121:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.154130:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff813200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762968.154136:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.154148:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.154167:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762968.154177:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddb1f528/0x5915dfb1c1b5ba9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762968.154271:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246683136:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6097us (97692us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789762968.154284:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 409 00000100:00100000:3.0:1789762968.154299:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270585230245 time 270585357974 state 0x2 ref 0 00000100:00100000:3.0:1789762968.157922:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762968.158034:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683264 00000100:00100000:1.0:1789762968.158048:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683264 00000100:00100000:1.0:1789762968.158107:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270585230245 time 270585357974 state 0x0 ref 1 00000100:00100000:1.0:1789762968.158124:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270685357974 time 270585357974 state 0x1 ref 1 00000100:00100000:2.0:1789762968.248315:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270685357974 time 270685526808 state 0x0 ref 1 00000100:00100000:2.0:1789762968.248376:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246683264:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762968.248476:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.248499:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762968.248506:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762968.248515:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.248533:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.255509:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.255542:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.255564:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.255577:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff445400 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762968.255584:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.255620:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.255646:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.255675:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087d9cbc0/0x5915dfb1c1b5baa4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762968.255839:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246683264:12345-192.168.203.36@tcp:3:dd.0 Request processed in 7473us (97915us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762968.255854:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 410 00000100:00100000:0.0:1789762968.255870:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270685357974 time 270685526808 state 0x2 ref 0 00000100:00100000:2.0:1789762968.259382:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762968.259505:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683392 00000100:00100000:3.0:1789762968.259521:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683392 00000100:00100000:3.0:1789762968.259593:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270685357974 time 270685526808 state 0x0 ref 1 00000100:00100000:3.0:1789762968.259627:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270785526808 time 270685526808 state 0x1 ref 1 00000100:00100000:2.0:1789762968.348517:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270785526808 time 270785738089 state 0x0 ref 1 00000100:00100000:2.0:1789762968.348555:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246683392:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:2.0:1789762968.348615:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.348682:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762968.348689:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762968.348697:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.348719:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.355277:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.355298:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.355325:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.355338:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff444800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762968.355345:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.355389:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.355461:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.355478:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7b87e59/0x5915dfb1c1b5baab lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762968.355589:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246683392:12345-192.168.203.36@tcp:3:dd.0 Request processed in 7045us (96207us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762968.355606:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 411 00000100:00100000:0.0:1789762968.355622:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270785526808 time 270785738089 state 0x2 ref 0 00000100:00100000:1.0:1789762968.359175:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762968.359262:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683520 00000100:00100000:3.0:1789762968.359276:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683520 00000100:00100000:3.0:1789762968.359337:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270785526808 time 270785738089 state 0x0 ref 1 00000100:00100000:3.0:1789762968.359365:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270885738089 time 270785738089 state 0x1 ref 1 00000100:00100000:3.0:1789762968.379052:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789762968.379087:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c4bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254936832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789762968.379228:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762968.379350:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936832 00000100:00100000:0.0:1789762968.379367:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936832 00000100:00080000:3.0:1789762968.379494:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762968.379514:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789762968.379537:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254936832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762968.379611:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3818811392 avail 3587289088 00000100:00100000:0.0:1789762968.379702:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254936832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762968.379718:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789762968.379836:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c4bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254936832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789762968.442958:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762968.448670:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270885738089 time 270885892691 state 0x0 ref 1 00000100:00100000:0.0:1789762968.448711:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246683520:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762968.448825:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.448853:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762968.448860:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762968.448868:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.448888:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.455172:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.455214:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.455227:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.455237:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82cc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762968.455244:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.455256:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.455283:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.455308:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b68e3e3/0x5915dfb1c1b5bab2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762968.455453:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2356:x1876702246683520:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6743us (96282us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762968.455476:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 412 00000100:00100000:2.0:1789762968.455492:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270885738089 time 270885892691 state 0x2 ref 0 00000100:00100000:3.0:1789762968.458624:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762968.458785:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683648 00000100:00100000:0.0:1789762968.458801:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683648 00000100:00100000:0.0:1789762968.458866:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270885738089 time 270885892691 state 0x0 ref 1 00000100:00100000:0.0:1789762968.458886:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270985892691 time 270885892691 state 0x1 ref 1 00000100:00100000:0.0:1789762968.548819:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270985892691 time 270986037153 state 0x0 ref 1 00000100:00100000:0.0:1789762968.548857:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246683648:12345-192.168.203.36@tcp:3:dd.0 00010000:00010000:0.0:1789762968.548915:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.548939:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762968.548945:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762968.548953:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.548994:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.555218:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.555240:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.555252:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.555261:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82de00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762968.555268:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.555280:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.555305:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.555331:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000841cdfa5/0x5915dfb1c1b5bab9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762968.555451:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2355:x1876702246683648:12345-192.168.203.36@tcp:3:dd.0 Request processed in 6605us (96828us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789762968.555466:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 413 00000100:00100000:2.0:1789762968.555482:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270985892691 time 270986037153 state 0x2 ref 0 00000100:00100000:3.0:1789762968.599788:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762968.599895:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683776 00000100:00100000:1.0:1789762968.599909:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683776 00000100:00100000:1.0:1789762968.599983:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:1.0:1789762968.599991:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:5431:x1876702246683776:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762968.600004:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762968.600048:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5b7f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894494a expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.600074:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762968.600126:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:5431:x1876702246683776:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 136us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762968.600149:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:1.0:1789762968.615549:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762968.615630:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246683904 00000100:00100000:0.0:1789762968.615652:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246683904 00000100:00080000:3.0:1789762968.615738:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762968.615796:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:1.0:1789762968.615809:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:12066:x1876702246683904:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1789762968.615837:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762968.615853:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5bac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944951 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.615904:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5bac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.615915:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5bac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.615924:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5bac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762968.615961:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00000004:00200000:1.0:1789762968.615964:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762968.615978:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5bac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.615994:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5bac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944951 expref: 11 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.616007:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5bac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944951 expref: 10 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.616013:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721dd00) 00010000:00010000:1.0:1789762968.616030:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762968.616033:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767d000, rc 0) 00000100:00100000:1.0:1789762968.616064:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:12066:x1876702246683904:12345-192.168.203.36@tcp:101:bash.0 Request processed in 260us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762968.616069:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:0.0:1789762968.622689:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762968.622785:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246684160 00000100:00100000:1.0:1789762968.622795:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246684160 00000100:00100000:1.0:1789762968.622844:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:1.0:1789762968.622854:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:13009:x1876702246684160:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:1.0:1789762968.622863:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762968.622873:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5bace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944958 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762968.622920:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00010000:00010000:1.0:1789762968.623009:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5bace lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944958 expref: 12 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.623018:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92c00) 00010000:00010000:1.0:1789762968.623019:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789762968.623022:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c800/0x5915dfb1c1b5bace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944958 expref: 12 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.623031:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767c800, rc 0) 00000100:00100000:1.0:1789762968.623072:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13009:x1876702246684160:12345-192.168.203.36@tcp:101:rm.0 Request processed in 221us (394us total) trans 4294967484 rc 301/301 00000100:00100000:1.0:1789762968.623078:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:3.0:1789762968.625485:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762968.625558:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246684288 00000100:00100000:2.0:1789762968.625568:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246684288 00000100:00100000:2.0:1789762968.625619:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:2.0:1789762968.625631:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0af9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13009:x1876702246684288:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:3.0:1789762968.628671:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0af9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13009:x1876702246684288:12345-192.168.203.36@tcp:37:rm.0 Request processed in 3038us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762968.628682:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:0.0:1789762968.630821:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762968.630901:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246684544 00000100:00100000:2.0:1789762968.630910:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246684544 00000100:00100000:2.0:1789762968.630958:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:2.0:1789762968.630971:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13009:x1876702246684544:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762968.631186:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:13009:x1876702246684544:12345-192.168.203.36@tcp:35:rm.0 Request processed in 217us (367us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789762968.631197:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:0.0:1789762968.632829:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762968.632906:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246684800 00000100:00100000:2.0:1789762968.632915:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246684800 00000100:00100000:2.0:1789762968.632963:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:2.0:1789762968.632977:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:13009:x1876702246684800:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:2.0:1789762968.632995:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762968.633026:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5badc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894495f expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.633112:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bae3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.633130:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.633144:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762968.633157:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00010000:00010000:2.0:1789762968.633224:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5badc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894495f expref: 15 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.633242:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894495f expref: 14 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.633252:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721dd00) 00010000:00010000:2.0:1789762968.633256:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762968.633259:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0ceec00, rc 0) 00000100:00100000:2.0:1789762968.633303:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13009:x1876702246684800:12345-192.168.203.36@tcp:101:rm.0 Request processed in 330us (477us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789762968.633310:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:1.0:1789762968.634702:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762968.634788:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246684928 00000100:00100000:0.0:1789762968.634799:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246684928 00000100:00100000:0.0:1789762968.634868:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:0.0:1789762968.634883:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13009:x1876702246684928:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:0.0:1789762968.634930:0:9183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7742480384 avail 7279435776 00000100:00100000:0.0:1789762968.634981:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13009:x1876702246684928:12345-192.168.203.36@tcp:41:rm.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762968.634989:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:0.0:1789762968.636282:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762968.636336:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246685184 00000100:00100000:3.0:1789762968.636343:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246685184 00000100:00100000:3.0:1789762968.636383:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:3.0:1789762968.636410:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13009:x1876702246685184:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762968.636556:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:13009:x1876702246685184:12345-192.168.203.36@tcp:35:rm.0 Request processed in 161us (272us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789762968.636582:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:3.0:1789762968.637623:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762968.637691:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246685440 00000100:00100000:0.0:1789762968.637700:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246685440 00000100:00100000:0.0:1789762968.637801:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 236 00000100:00100000:0.0:1789762968.637822:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:13009:x1876702246685440:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762968.637870:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762968.637894:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767de00/0x5915dfb1c1b5b7e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944943 expref: 15 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.637933:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460400/0x5915dfb1c1b5b502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894493c expref: 14 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.637945:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b33f4535600) 00010000:00010000:0.0:1789762968.637960:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d000/0x5915dfb1c1b5bac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944951 expref: 13 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.637968:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721dd00) 00010000:00010000:0.0:1789762968.637972:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762968.637986:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.637995:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638003:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638017:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638023:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638030:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638113:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638148:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638156:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789762968.638452:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9024 00000004:00080000:0.0:1789762968.638465:0:5924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271075712957ns, next at 272075710060ns, rc = 0 00010000:00010000:0.0:1789762968.638505:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638514:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638522:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638530:0:5924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638537:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638543:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638564:0:5924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762968.638578:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638583:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638598:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638606:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82dc00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762968.638610:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762968.638612:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638622:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638624:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638653:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b33fed74d00) 00010000:00010000:0.0:1789762968.638658:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762968.638662:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638665:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c000 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762968.638678:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5baff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638679:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638720:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638736:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638738:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b33fed74d00) 00010000:00010000:1.0:1789762968.638779:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789762968.638783:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638785:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638823:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c000/0x5915dfb1c1b5bb06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638831:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638845:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762968.638845:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762968.638848:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762968.638854:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762968.638854:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762968.638881:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638893:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721dd00) 00010000:00010000:0.0:1789762968.638895:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762968.638898:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.638904:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c200/0x5915dfb1c1b5baf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762968.638916:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a93c3f73 reply state 00000000663f6333 transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762968.638924:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762968.638976:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13009:x1876702246685440:12345-192.168.203.36@tcp:36:rm.0 Request processed in 1164us (1354us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1789762968.638983:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 236 00010000:00010000:0.0:1789762968.639621:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.639629:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.639636:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.639640:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762968.639644:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.639661:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.639671:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4009f790 (ffff9b33fed74300) 00010000:00010000:0.0:1789762968.639674:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762968.639676:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.639682:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5baf8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762968.640356:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762968.640471:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246685696 00000100:00100000:2.0:1789762968.640480:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246685696 00000100:00100000:2.0:1789762968.640526:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:2.0:1789762968.640537:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:13009:x1876702246685696:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762968.640672:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13009:x1876702246685696:12345-192.168.203.36@tcp:35:rm.0 Request processed in 135us (316us total) trans 4294967489 rc 0/0 00000100:00100000:2.0:1789762968.640683:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:1.0:1789762968.641697:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762968.641796:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246685952 00000100:00100000:0.0:1789762968.641806:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246685952 00000100:00100000:0.0:1789762968.641866:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:0.0:1789762968.641878:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13009:x1876702246685952:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762968.641925:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789762968.641938:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894495f expref: 14 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.641955:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5b4e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944935 expref: 13 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.641964:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33f721dd00) 00010000:00010000:0.0:1789762968.641975:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5b484 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944920 expref: 12 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.641983:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92c00) 00010000:00010000:0.0:1789762968.641997:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762968.642011:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642020:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642028:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642037:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642044:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642050:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642091:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642098:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642105:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762968.642234:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 4096 00010000:00010000:0.0:1789762968.642245:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642251:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642264:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642270:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762968.642273:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642278:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642287:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b33fed74800) 00010000:00010000:0.0:1789762968.642289:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762968.642292:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642298:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bb1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642315:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642325:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642333:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642340:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762968.642344:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642369:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642382:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fed74b00) 00010000:00010000:0.0:1789762968.642386:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762968.642408:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762968.642415:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c600/0x5915dfb1c1b5bb0d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789762968.642430:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000798fff9c reply state 00000000a3c5e9b0 transno 4294967490 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762968.642436:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762968.642484:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+13:13009:x1876702246685952:12345-192.168.203.36@tcp:36:rm.0 Request processed in 608us (788us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1789762968.642492:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 237 00010000:00010000:2.0:1789762968.643303:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.643315:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.643322:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.643327:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762968.643330:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.643337:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.643347:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fed74400) 00010000:00010000:2.0:1789762968.643350:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762968.643353:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762968.643359:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d400/0x5915dfb1c1b5bb14 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762969.404133:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967741 is committed 00010000:00010000:0.0:1789762969.466859:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789762969.704571:0:14692:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272141816441ns, next at 272075710060ns, rc = 0 00080000:00080000:3.0:1789762969.704589:0:14692:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789762969.705514:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000001:00080000:1.0:1789762969.705535:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967490 is committed 00000004:00080000:1.0:1789762969.705544:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000100:00100000:0.0:1789762969.705661:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789762969.705686:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b33ffd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254936960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789762969.705801:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762969.705847:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254936960 00000100:00100000:1.0:1789762969.705858:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254936960 00000100:00100000:1.0:1789762969.705917:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789762969.705927:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254936960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789762969.705969:0:12943:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:13 count 1 00002000:00010000:1.0:1789762969.706004:0:12943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 104857600, mtime: 0x6aad9d8f, atime: 0x0, ctime: 0x6aad9d8f, blocks: 0x32000 00010000:00010000:1.0:1789762969.706011:0:12943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762969.706028:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=272s v=(0 0) 00010000:00010000:1.0:1789762969.706032:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762969.706037:0:12943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762969.706051:0:12943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762969.706059:0:12943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762969.706065:0:12943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762969.706082:0:12943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762969.706108:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762969.706116:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762969.706126:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762969.706130:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762969.706144:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762969.706163:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762969.706168:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5bb22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762969.706183:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762969.706185:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789762969.706187:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762969.706243:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254936960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 316us (444us total) trans 4294967742 rc 0/0 00000100:00100000:1.0:1789762969.706250:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789762969.706264:0:3419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967741 gen 2 00000004:00080000:0.0:1789762969.706269:0:3419:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b32c172a300, transno 4294967741 00000100:00100000:0.0:1789762969.706284:0:3419:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b33ffd82680 x1876702254936960/t4294967742(4294967742) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789762985 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789762969.706294:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b33ffd82680/2, rc 0, transno 4294967742 00000100:00100000:0.0:1789762969.706306:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b33ffd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254936960:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789762969.706450:0:14692:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 272143697255ns, next at 259528288254ns, rc = 0 00080000:00080000:1.0:1789762969.706459:0:14692:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789762969.707168:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00010000:00010000:1.0:1789762970.490940:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762971.450922:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254937088:0@lo:400:kworker.0 00000100:00100000:0.0:1789762971.450930:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254937216:0@lo:400:kworker.0 00000100:00100000:1.0:1789762971.450960:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254937472:0@lo:400:kworker.0 00000100:00100000:3.0:1789762971.451033:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762971.451034:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762971.451058:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762971.451135:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789762971.451137:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254937728:0@lo:400:kworker.0 00000100:00100000:3.0:1789762971.451137:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c231a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254937600:0@lo:400:kworker.0 00000100:00100000:1.0:1789762971.451145:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c2319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254937344:0@lo:400:kworker.0 00000100:00100000:0.0:1789762971.451205:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762971.451205:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762971.451215:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937088 00000100:00100000:1.0:1789762971.451222:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937088 00000100:00100000:1.0:1789762971.451285:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789762971.451290:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937216 00000100:00100000:1.0:1789762971.451300:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762971.451301:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937472 00000100:00100000:0.0:1789762971.451302:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937216 00000100:00100000:3.0:1789762971.451312:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937472 00000100:00100000:0.0:1789762971.451390:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937600 00000100:00100000:3.0:1789762971.451393:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937728 00000100:00100000:0.0:1789762971.451395:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937600 00000100:00100000:1.0:1789762971.451401:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3417:x1876702254937088:12345-0@lo:400:kworker.0 Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762971.451402:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937728 00000100:00100000:1.0:1789762971.451421:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789762971.451450:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789762971.451460:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789762971.451467:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254937216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762971.451472:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254937472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762971.451487:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789762971.451499:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254937728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762971.451547:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1876702254937216:12345-0@lo:400:kworker.0 Request processed in 83us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762971.451547:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3420:x1876702254937472:12345-0@lo:400:kworker.0 Request processed in 74us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762971.451558:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1876702254937728:12345-0@lo:400:kworker.0 Request processed in 60us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762971.451567:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789762971.451567:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789762971.451574:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789762971.451616:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789762971.451630:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254937600:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762971.451635:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789762971.451644:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762971.451645:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789762971.451650:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789762971.451708:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937344 00000100:00100000:1.0:1789762971.451709:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254937472:0@lo:400:kworker.0 00000100:00100000:0.0:1789762971.451712:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1876702254937600:12345-0@lo:400:kworker.0 Request processed in 77us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762971.451714:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937344 00000100:00100000:0.0:1789762971.451733:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789762971.451823:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789762971.451840:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254937344:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789762971.451854:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762971.451907:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254937344:12345-0@lo:400:kworker.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762971.451923:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789762971.451924:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254937856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762971.451959:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1876702254937600:0@lo:400:kworker.0 00000100:00100000:1.0:1789762971.451974:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254937344:0@lo:400:kworker.0 00000100:00100000:0.0:1789762971.451985:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762971.451997:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c2319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3417:1876702254937088:0@lo:400:kworker.0 00000100:00100000:1.0:1789762971.452051:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1876702254937728:0@lo:400:kworker.0 00000100:00100000:0.0:1789762971.452066:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937856 00000100:00100000:0.0:1789762971.452073:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937856 00000100:00100000:1.0:1789762971.452084:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c231b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1876702254937216:0@lo:400:kworker.0 00000100:00100000:0.0:1789762971.452146:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789762971.452163:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254937856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789762971.452196:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33784384 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762971.452252:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254937856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762971.452261:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789762971.452309:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254937856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789762971.514891:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762972.035905:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762972.035962:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762972.035962:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686208 00000100:00100000:3.0:1789762972.035979:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686208 00000100:00100000:1.0:1789762972.036014:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:0.0:1789762972.036048:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789762972.036090:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 186 00000100:00100000:2.0:1789762972.036092:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686080 00000100:00100000:1.0:1789762972.036099:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762972.036115:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246686208:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762972.036116:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686336 00000100:00100000:2.0:1789762972.036119:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686080 00000100:00100000:0.0:1789762972.036125:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686336 00000100:00100000:1.0:1789762972.036149:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762972.036197:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 281 00000100:00100000:0.0:1789762972.036207:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686464 00000100:00100000:0.0:1789762972.036213:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686464 00000100:00100000:2.0:1789762972.036214:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246686080:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762972.036215:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:3.0:1789762972.036233:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246686208:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762972.036241:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246686336:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762972.036250:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 186 00000100:00100000:0.0:1789762972.036274:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:3.0:1789762972.036283:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686592 00000100:00100000:3.0:1789762972.036293:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686592 00000100:00100000:0.0:1789762972.036296:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246686464:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762972.036296:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2355:x1876702246686080:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762972.036310:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2355:x1876702246686336:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762972.036330:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:2.0:1789762972.036335:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 281 00000100:00100000:1.0:1789762972.036345:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:3.0:1789762972.036347:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246686592:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1789762972.036362:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2356:x1876702246686464:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762972.036389:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:3.0:1789762972.036403:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2355:x1876702246686592:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 57us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762972.036410:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00080000:1.0:1789762972.036448:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789762972.036457:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789762972.036462:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789762972.538976:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789762973.498980:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789762973.499005:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254937984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762973.499072:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762973.499138:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254937984 00000100:00100000:0.0:1789762973.499148:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254937984 00000100:00080000:1.0:1789762973.499212:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762973.499232:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789762973.499243:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254937984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762973.499270:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484917824 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762973.499314:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1876702254937984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762973.499320:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789762973.499366:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254937984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789762973.562944:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789762974.586853:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789762975.547997:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967742 is committed 00010000:00010000:2.0:1789762975.610838:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789762976.570929:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254938240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789762976.570938:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254938112:0@lo:400:kworker.0 00000100:00100000:0.0:1789762976.570943:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254938496:0@lo:400:kworker.0 00000100:00100000:1.0:1789762976.570963:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254938368:0@lo:400:kworker.0 00000100:00100000:2.0:1789762976.571019:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789762976.571027:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762976.571028:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762976.571066:0:5920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254938112 00000100:00100000:1.0:1789762976.571075:0:5920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254938112 00000100:00100000:3.0:1789762976.571089:0:3417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254938624:0@lo:400:kworker.0 00000100:00100000:2.0:1789762976.571092:0:3418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254938752:0@lo:400:kworker.0 00000100:00100000:0.0:1789762976.571102:0:10188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254938240 00000100:00100000:0.0:1789762976.571107:0:10188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254938240 00000100:00100000:1.0:1789762976.571129:0:5920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789762976.571130:0:3417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762976.571138:0:3418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789762976.571144:0:5920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254938112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762976.571162:0:10188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789762976.571175:0:10188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254938240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762976.571186:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254938624 00000100:00100000:3.0:1789762976.571192:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254938624 00002000:00000024:0.0:1789762976.571199:0:10188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33784384 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789762976.571210:0:5920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bdabba9-4e53-49d7-a41a-aa00b9b69f52+19:3418:x1876702254938112:12345-0@lo:400:kworker.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762976.571217:0:5920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789762976.571221:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9bdabba9-4e53-49d7-a41a-aa00b9b69f52:3418:1876702254938112:0@lo:400:kworker.0 00000100:00100000:3.0:1789762976.571238:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789762976.571252:0:10188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254938240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762976.571252:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254938624:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789762976.571259:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762976.571264:0:10188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789762976.571276:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789762976.571300:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254938496 00000100:00100000:1.0:1789762976.571301:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254938752 00000100:00100000:2.0:1789762976.571306:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254938240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789762976.571306:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1876702254938624:12345-0@lo:400:kworker.0 Request processed in 58us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762976.571309:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254938752 00000100:00100000:0.0:1789762976.571313:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254938496 00000100:00100000:3.0:1789762976.571322:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789762976.571350:0:3417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967742 gen 2 00000004:00080000:2.0:1789762976.571355:0:3417:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b33ffd82680, transno 4294967742 00000100:00100000:2.0:1789762976.571367:0:3417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1876702254938624:0@lo:400:kworker.0 00000100:00100000:1.0:1789762976.571382:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789762976.571391:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789762976.571395:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254938752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789762976.571405:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254938496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789762976.571444:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1876702254938752:12345-0@lo:400:kworker.0 Request processed in 54us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762976.571452:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789762976.571459:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1876702254938496:12345-0@lo:400:kworker.0 Request processed in 57us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762976.571466:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789762976.571473:0:3418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1876702254938752:0@lo:400:kworker.0 00000100:00080000:1.0:1789762976.571477:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789762976.571493:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762976.571510:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1876702254938496:0@lo:400:kworker.0 00000100:00100000:1.0:1789762976.571520:0:3419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c1480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254938880:0@lo:400:kworker.0 00000100:00100000:2.0:1789762976.571530:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254938368 00000100:00100000:2.0:1789762976.571536:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254938368 00000100:00100000:1.0:1789762976.571542:0:3419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789762976.571574:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789762976.571583:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254938368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789762976.571589:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254938880 00000100:00100000:3.0:1789762976.571595:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254938880 00000100:00100000:3.0:1789762976.571627:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789762976.571638:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1876702254938368:12345-0@lo:400:kworker.0 Request processed in 54us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762976.571638:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254938880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789762976.571652:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789762976.571689:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3419:x1876702254938880:12345-0@lo:400:kworker.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762976.571693:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1876702254938368:0@lo:400:kworker.0 00000100:00100000:3.0:1789762976.571698:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789762976.571719:0:3419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c1480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1876702254938880:0@lo:400:kworker.0 00010000:00010000:3.0:1789762976.634938:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762977.156077:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762977.156110:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762977.156145:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762977.156180:0:5919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686720 00000100:00100000:2.0:1789762977.156196:0:5919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686720 00000100:00100000:1.0:1789762977.156207:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686976 00000100:00100000:1.0:1789762977.156230:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686976 00000100:00100000:3.0:1789762977.156234:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246686848 00000100:00100000:3.0:1789762977.156243:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246686848 00000100:00080000:0.0:1789762977.156308:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789762977.156317:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789762977.156349:0:5919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 283 00000100:00100000:1.0:1789762977.156366:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:3.0:1789762977.156367:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1789762977.156380:0:5919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246686720:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1789762977.156384:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246686848:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1789762977.156395:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246686976:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1789762977.156507:0:5919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6183be2-02c3-467f-81fa-2ef6138a604e+13:2354:x1876702246686720:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 139us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762977.156522:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246686848:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 126us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762977.156523:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2354:x1876702246686976:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 121us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762977.156552:0:5919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 283 00000100:00100000:3.0:1789762977.156579:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:1.0:1789762977.156580:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:3.0:1789762977.158575:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762977.158613:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762977.158638:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246687104 00000100:00100000:2.0:1789762977.158645:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246687104 00000100:00100000:1.0:1789762977.158673:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246687232 00000100:00100000:1.0:1789762977.158681:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246687232 00000100:00100000:2.0:1789762977.158709:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00080000:0.0:1789762977.158720:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762977.158732:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:2352:x1876702246687104:12345-192.168.203.36@tcp:9:kworker.0 00000100:00080000:0.0:1789762977.158733:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789762977.158747:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:1.0:1789762977.158814:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246687232:12345-192.168.203.36@tcp:400:kworker.0 00000020:00000080:2.0:1789762977.158833:0:12136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5915dfb1c1b5a98d 00000100:00080000:2.0:1789762977.158847:0:12136:0:(import.c:65:import_set_state_nolock()) ffff9b32c5c0d800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789762977.158871:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16ee4165-0fa4-42d2-b611-78faaebc19a7+5:2353:x1876702246687232:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 58us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762977.158899:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 192 00010000:00010000:3.0:1789762977.158901:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789762977.158907:0:12136:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:2.0:1789762977.159164:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+2:2352:x1876702246687104:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 442us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762977.159176:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 123 00010000:00010000:1.0:1789762977.658834:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789762977.861824:0:15103:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789762977.861830:0:15103:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:3.0:1789762977.892202:0:15118:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789762977.892211:0:15118:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789762978.248671:0:15174:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762978.248689:0:15174:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762978.248696:0:15174:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762978.248703:0:15174:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762978.248712:0:15174:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762978.248719:0:15174:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f73f2700 rate 20 gen 0 00000100:00100000:3.0:1789762978.248723:0:15174:0:(nrs_tbf.c:706:nrs_tbf_rule_start()) TBF allowed type: count=0 00000100:00100000:3.0:1789762978.248735:0:15174:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: nid, str: 0@lo 192.168.203.36@tcp 00000100:00100000:3.0:1789762978.248873:0:15174:0:(nrs_tbf.c:1778:nrs_tbf_expression_parse()) type: 0X7F, dynamic 0, field: jobid, str: dd.500 00000100:00100000:3.0:1789762978.248886:0:15174:0:(nrs_tbf.c:761:nrs_tbf_rule_start()) TBF starts rule@ffff9b33f73f2000 rate 20 gen 0 00000100:00100000:1.0:1789762978.262925:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762978.262980:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246687360 00000100:00100000:0.0:1789762978.262992:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246687360 00000100:00100000:0.0:1789762978.263060:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 238 00000100:00100000:0.0:1789762978.263073:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:13457:x1876702246687360:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:0.0:1789762978.263095:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762978.263116:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bb29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944966 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.263178:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bb30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.263195:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.263211:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762978.263266:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762978.263271:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762978.263294:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.263338:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bb29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944966 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.263364:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bb30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944966 expref: 6 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.263371:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721dc00) 00010000:00010000:0.0:1789762978.263373:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762978.263375:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82dc00, rc 0) 00000100:00100000:0.0:1789762978.263436:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:13457:x1876702246687360:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 368us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762978.263441:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 238 00000100:00100000:1.0:1789762978.264845:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.264877:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246687616 00000100:00100000:3.0:1789762978.264884:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246687616 00000100:00100000:3.0:1789762978.264920:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 239 00000100:00100000:3.0:1789762978.264930:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:13457:x1876702246687616:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:3.0:1789762978.264963:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762978.264981:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bb30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944966 expref: 6 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.264992:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721dc00) 00010000:00010000:3.0:1789762978.264999:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762978.265039:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265046:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265056:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265075:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265084:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265093:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.265607:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00010000:00010000:3.0:1789762978.265617:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265625:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265632:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265639:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.265644:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265652:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265664:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92b00) 00010000:00010000:3.0:1789762978.265667:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.265672:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.265679:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb37 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762978.265698:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbe1fc6e reply state 00000000a4869688 transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762978.265707:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789762978.265810:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:13457:x1876702246687616:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 879us (961us total) trans 4294967491 rc 0/0 00000100:00100000:3.0:1789762978.265831:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 239 00010000:00010000:2.0:1789762978.266643:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.266661:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.266672:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.266689:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.266695:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.266705:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.266725:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fec92d00) 00010000:00010000:2.0:1789762978.266729:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.266734:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.266741:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb3e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762978.274037:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.274106:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246687744 00000100:00100000:3.0:1789762978.274160:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246687744 00000100:00100000:3.0:1789762978.274215:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 240 00000100:00100000:3.0:1789762978.274228:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:13458:x1876702246687744:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762978.274252:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.274275:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894496d expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.274362:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5bb4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.274378:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5bb4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.274391:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5bb4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.274442:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762978.274446:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762978.274467:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5bb4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.274492:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663000/0x5915dfb1c1b5bb45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894496d expref: 8 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.274509:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5bb4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894496d expref: 7 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.274532:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92b00) 00010000:00010000:3.0:1789762978.274536:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762978.274540:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1663e00, rc 0) 00000100:00100000:3.0:1789762978.274610:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:13458:x1876702246687744:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 384us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762978.274618:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 240 00000100:00100000:2.0:1789762978.275967:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.276028:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246688000 00000100:00100000:3.0:1789762978.276036:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246688000 00000100:00100000:3.0:1789762978.276088:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:3.0:1789762978.276098:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:13458:x1876702246688000:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762978.276108:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.276111:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789762978.276126:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663e00/0x5915dfb1c1b5bb4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894496d expref: 7 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276138:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92b00) 00010000:00010000:3.0:1789762978.276146:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762978.276156:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b5bb53 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944974 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276247:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276258:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276267:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276287:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276296:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276303:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276377:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276387:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276395:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.276403:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00010000:00010000:3.0:1789762978.276426:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276434:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276441:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276448:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.276452:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276470:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276480:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33fec92100) 00010000:00010000:3.0:1789762978.276483:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.276486:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276493:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662a00/0x5915dfb1c1b5bb68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276509:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276516:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276523:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276529:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1662000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.276532:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276539:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276547:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92a00) 00010000:00010000:3.0:1789762978.276550:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.276564:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276580:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662000/0x5915dfb1c1b5bb5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276590:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276596:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276603:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276608:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33c1663a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.276612:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276619:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276628:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fec92400) 00010000:00010000:3.0:1789762978.276631:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.276634:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276640:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1663a00/0x5915dfb1c1b5bb61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276664:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b5bb53 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944974 expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276685:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92a00) 00010000:00010000:3.0:1789762978.276687:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.276692:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c1662800/0x5915dfb1c1b5bb53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944974 expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.276704:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c1662800, rc 0) 00000100:00100000:3.0:1789762978.276743:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:13458:x1876702246688000:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 646us (784us total) trans 0 rc 301/301 00000100:00100000:3.0:1789762978.276796:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:1.0:1789762978.278317:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.278368:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246688128 00000100:00100000:3.0:1789762978.278375:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246688128 00000100:00100000:3.0:1789762978.278420:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 242 00000100:00100000:3.0:1789762978.278431:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:13458:x1876702246688128:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762978.278441:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.278453:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894497b expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.278487:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a000/0x5915dfb1c1b5bb76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.278498:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a000/0x5915dfb1c1b5bb76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.278507:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a000/0x5915dfb1c1b5bb76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.278527:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789762978.278535:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762978.278551:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a000/0x5915dfb1c1b5bb76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.278580:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894497b expref: 8 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.278594:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a000/0x5915dfb1c1b5bb76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894497b expref: 7 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.278603:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92e00) 00010000:00010000:3.0:1789762978.278606:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762978.278609:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54a000, rc 0) 00000100:00100000:3.0:1789762978.278644:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:13458:x1876702246688128:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 215us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762978.278652:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 242 00000100:00100000:1.0:1789762978.280152:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.280223:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246688384 00000100:00100000:2.0:1789762978.280237:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246688384 00000100:00100000:3.0:1789762978.280382:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 243 00000100:00100000:3.0:1789762978.280400:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:13458:x1876702246688384:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762978.280422:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.280433:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bb7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944982 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280485:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280496:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280506:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280526:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280535:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280543:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.280598:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00010000:00010000:3.0:1789762978.280670:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280679:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280686:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280692:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54b800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.280695:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280703:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280712:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92e00) 00010000:00010000:3.0:1789762978.280715:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.280719:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280735:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bb84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280746:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280778:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280786:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280793:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54a400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.280797:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280806:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280816:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fec92f00) 00010000:00010000:3.0:1789762978.280820:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.280823:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280830:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bb8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280866:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bb7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944982 expref: 9 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280899:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92e00) 00010000:00010000:3.0:1789762978.280902:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762978.280906:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bb7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944982 expref: 9 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.280916:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54ac00, rc 0) 00000100:00100000:3.0:1789762978.280952:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:13458:x1876702246688384:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 560us (803us total) trans 4294967492 rc 301/301 00000100:00100000:3.0:1789762978.280960:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 243 00000100:00100000:2.0:1789762978.282269:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.282362:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246688640 00000100:00100000:3.0:1789762978.282370:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246688640 00000100:00100000:3.0:1789762978.282426:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 244 00000100:00100000:3.0:1789762978.282435:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:13458:x1876702246688640:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:3.0:1789762978.282489:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.282501:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.282510:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762978.282606:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4a32458 reply state 000000001fb21df5 transno 4294967493 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762978.282616:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762978.282621:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00000100:00100000:3.0:1789762978.282680:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:13458:x1876702246688640:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 244us (416us total) trans 4294967493 rc 0/0 00000100:00100000:3.0:1789762978.282688:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 244 00010000:00010000:2.0:1789762978.283679:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.283698:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.283709:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.283717:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54ba00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.283741:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.283762:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.283901:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33fec92a00) 00010000:00010000:2.0:1789762978.283907:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789762978.283914:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.283922:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ba00/0x5915dfb1c1b5bb99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762978.283992:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.284061:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246688896 00000100:00100000:2.0:1789762978.284070:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246688896 00000100:00100000:2.0:1789762978.284129:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:2.0:1789762978.284147:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+9:13458:x1876702246688896:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1789762978.284467:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:13458:x1876702246688896:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 321us (470us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789762978.284484:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:1.0:1789762978.292110:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.292165:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246689024 00000100:00100000:3.0:1789762978.292175:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246689024 00000100:00100000:3.0:1789762978.292229:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 245 00000100:00100000:3.0:1789762978.292240:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c1482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:13459:x1876702246689024:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:3.0:1789762978.292260:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.292276:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bba0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944989 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292347:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292361:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292372:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292386:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292395:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292403:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292462:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292483:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292491:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.292522:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00000004:00200000:3.0:1789762978.292526:0:7598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762978.292541:0:7598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292553:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292561:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292569:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292576:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54a400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.292580:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292589:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292601:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92e00) 00010000:00010000:3.0:1789762978.292604:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.292609:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292625:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292638:0:7598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292645:0:7598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292651:0:7598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292657:0:7598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54b800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.292661:0:7598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292668:0:7598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292676:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fec92f00) 00010000:00010000:3.0:1789762978.292680:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.292683:0:7598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292690:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292718:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bba0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944989 expref: 12 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292732:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944989 expref: 11 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.292746:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33fec92400) 00010000:00010000:3.0:1789762978.292769:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762978.292773:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54be00, rc 0) 00000100:00100000:3.0:1789762978.292824:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c1482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13459:x1876702246689024:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 585us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762978.292833:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 245 00000100:00100000:1.0:1789762978.294865:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.294922:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246689280 00000100:00100000:3.0:1789762978.294928:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246689280 00000100:00100000:3.0:1789762978.294964:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 246 00000100:00100000:3.0:1789762978.294973:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13459:x1876702246689280:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:3.0:1789762978.295001:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789762978.295015:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944989 expref: 11 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.295029:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33fec92400) 00010000:00010000:3.0:1789762978.295035:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789762978.295047:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.295057:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.295065:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762978.295172:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009abfc951 reply state 000000006785138f transno 4294967495 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762978.295191:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789762978.295196:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00000100:00100000:3.0:1789762978.295241:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:13459:x1876702246689280:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 268us (382us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789762978.295247:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 246 00010000:00010000:2.0:1789762978.296158:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.296174:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.296184:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.296193:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54ae00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.296198:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.296239:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.296271:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33fec92100) 00010000:00010000:2.0:1789762978.296278:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789762978.296287:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.296301:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ae00/0x5915dfb1c1b5bbbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762978.321585:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.321655:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246689408 00000100:00100000:2.0:1789762978.321678:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246689408 00000100:00100000:2.0:1789762978.321825:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 247 00000100:00100000:2.0:1789762978.321855:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13463:x1876702246689408:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762978.321895:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.321921:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5bbc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944990 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322006:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322024:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322038:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322056:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322078:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322086:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322211:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5bbd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322222:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322230:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762978.322265:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00000004:00200000:2.0:1789762978.322270:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762978.322290:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322305:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322313:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322344:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322353:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cee600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.322357:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322375:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322389:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92e00) 00010000:00010000:2.0:1789762978.322392:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.322397:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322405:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bbca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322420:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322426:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322433:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322439:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.322442:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322448:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322455:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2aad00) 00010000:00010000:2.0:1789762978.322458:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.322461:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322478:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bbd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322516:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5bbc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944990 expref: 13 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322533:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5bbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944990 expref: 12 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.322547:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:2.0:1789762978.322551:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789762978.322555:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cefa00, rc 0) 00000100:00100000:2.0:1789762978.322651:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:13463:x1876702246689408:12345-192.168.203.36@tcp:101:dd.500 Request processed in 809us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762978.322664:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 247 00000100:00100000:1.0:1789762978.324088:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.324138:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246689664 00000100:00100000:3.0:1789762978.324149:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246689664 00000100:00100000:3.0:1789762978.324204:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 248 00000100:00100000:3.0:1789762978.324217:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:13463:x1876702246689664:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:3.0:1789762978.324236:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.324255:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944997 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.324374:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.324390:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.324401:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.324416:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.324424:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.324430:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789762978.324854:0:9183:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00000004:00080000:3.0:1789762978.324862:0:9183:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb:0x0], index 1: 0 00010000:00010000:3.0:1789762978.324991:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bbf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325002:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325010:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325040:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325048:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325056:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325062:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54ac00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.325066:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325074:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325085:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:3.0:1789762978.325088:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762978.325093:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325106:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bbe6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789762978.325119:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053c8151d reply state 00000000cfd4761f transno 4294967496 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762978.325126:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789762978.325150:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54be00/0x5915dfb1c1b5bbdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944997 expref: 15 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325160:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944997 expref: 14 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.325165:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:3.0:1789762978.325167:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762978.325169:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54a400, rc 0) 00000100:00100000:3.0:1789762978.325219:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:13463:x1876702246689664:12345-192.168.203.36@tcp:101:dd.500 Request processed in 1006us (1135us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789762978.325224:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 248 00010000:00010000:2.0:1789762978.325954:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.325978:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.325986:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.325992:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54b800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.325996:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.326003:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.326029:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x3950208a (ffff9b33fec92400) 00010000:00010000:2.0:1789762978.326032:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.326036:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.326043:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b800/0x5915dfb1c1b5bbed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762978.328368:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762978.328437:0:7959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246689792 00000100:00100000:0.0:1789762978.328444:0:7959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246689792 00000100:00100000:0.0:1789762978.328481:0:7959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:0.0:1789762978.328488:0:7959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+5:13463:x1876702246689792:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:0.0:1789762978.328496:0:7959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762978.328509:0:7959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5bc02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b87894499e expref: -99 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789762978.328526:0:7959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789762978.328538:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1789762978.328548:0:7959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762978.328556:0:7959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5bc02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894499e expref: 6 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.328569:0:7959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5bc02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894499e expref: 6 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.328577:0:7959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82c200, rc 0) 00000100:00100000:0.0:1789762978.328606:0:7959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:13463:x1876702246689792:12345-192.168.203.36@tcp:101:dd.500 Request processed in 119us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762978.328611:0:7959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:1.0:1789762978.365874:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.365990:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246689920 00000100:00100000:3.0:1789762978.366000:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246689920 00002000:00100000:3.0:1789762978.366053:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xe:0x0] (0->4194303) req@ffff9b32c2319c00 x1876702246689920/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762978.366063:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c2319c00 with x1876702246689920 ext(0->4194303) 00002000:00010000:3.0:1789762978.366068:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c2319c00 00000100:00100000:1.0:1789762978.366076:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.366085:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235171531392 time 235171612207 state 0x0 ref 1 00000100:00100000:3.0:1789762978.366111:0:12138:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 6: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3100 gen 0 rate 20 depth 3 token 0 deadline 235171531392 time 235171612207 state 0x0 ref 1 00000100:00100000:0.0:1789762978.366139:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246690048 00000100:00100000:3.0:1789762978.366140:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 3 deadline 280853381182 time 280803381182 state 0x1 ref 1 00000100:00100000:0.0:1789762978.366145:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246690048 00000100:00100000:3.0:1789762978.366168:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 280853381182 time 280803411948 state 0x0 ref 1 00000100:00100000:0.0:1789762978.366185:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:0.0:1789762978.366191:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c231b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876702246690048:12345-192.168.203.36@tcp:8:dd.500 00010000:00080000:0.0:1789762978.366214:0:6909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp t0 exp 0000000000000000 cur 280 last 0 00000100:00100000:3.0:1789762978.366242:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2354:x1876702246689920:12345-192.168.203.36@tcp:4:dd.500 00000020:00000080:0.0:1789762978.366246:0:6909:0:(genops.c:1385:class_connect()) connect: client f07ac6c5-9215-4651-bbbc-5b452d5bdd86, cookie 0x5915dfb1c1b5bc09 00002000:00100000:0.0:1789762978.366258:0:6909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f07ac6c5-9215-4651-bbbc-5b452d5bdd86/ffff9b33ff7c1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396a ocd_grant: 33505280 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789762978.366267:0:6909:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789762978.366340:0:6909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789762978.366364:0:6909:0:(import.c:65:import_set_state_nolock()) ffff9b33ff7c4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789762978.366415:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c231b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:2352:x1876702246690048:12345-192.168.203.36@tcp:8:dd.500 Request processed in 223us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762978.366422:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:1.0:1789762978.367678:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.367800:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246690176 00000100:00100000:2.0:1789762978.367818:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246690176 00000100:00080000:0.0:1789762978.367895:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789762978.367932:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:2.0:1789762978.367950:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+6:13463:x1876702246690176:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:2.0:1789762978.367969:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.367998:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81fe260/0x5915dfb1c1b5bc10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449a5 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762978.368037:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789762978.368069:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=280s v=(0 0) 00010000:00010000:2.0:1789762978.368077:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762978.368094:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81fe260/0x5915dfb1c1b5bc10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449a5 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.368122:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b81fe260/0x5915dfb1c1b5bc10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449a5 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.368137:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef200, rc 0) 00000100:00100000:2.0:1789762978.368203:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:13463:x1876702246690176:12345-192.168.203.36@tcp:101:dd.500 Request processed in 262us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762978.368226:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:3.0:1789762978.385142:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2354:x1876702246689920:12345-192.168.203.36@tcp:4:dd.500 Request processed in 18954us (19265us total) trans 4294967743 rc 0/0 00000100:00100000:3.0:1789762978.385156:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 414 00000100:00100000:3.0:1789762978.385169:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 280853381182 time 280803411948 state 0x2 ref 0 00002000:00100000:3.0:1789762978.385185:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xe:0x0] (0->4194303) req@ffff9b32c2319c00 x1876702246689920/t4294967743(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762978.385196:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c2319c00 with x1876702246689920 ext(0->4194303) 00002000:00010000:3.0:1789762978.385203:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c2319c00 00000100:00100000:1.0:1789762978.404718:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.404833:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246690304 00000100:00100000:2.0:1789762978.404853:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246690304 00002000:00100000:2.0:1789762978.404923:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->4194303) req@ffff9b32c4def100 x1876702246690304/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762978.404941:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4def100 with x1876702246690304 ext(0->4194303) 00002000:00010000:2.0:1789762978.404948:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4def100 00000100:00100000:2.0:1789762978.404975:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 280853381182 time 280803411948 state 0x0 ref 1 00000100:00100000:2.0:1789762978.404996:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 280853411948 time 280803411948 state 0x1 ref 1 00000100:00100000:2.0:1789762978.405052:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280853411948 time 280842288054 state 0x0 ref 1 00000100:00100000:2.0:1789762978.405095:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246690304:12345-192.168.203.36@tcp:4:dd.500 00000001:00100000:1.0:1789762978.423331:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000001:00100000:1.0:1789762978.423342:0:7983:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:1.0:1789762978.423346:0:7983:0:(genops.c:885:class_export_put()) final put ffff9b32c5c08000/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 00000020:00000080:0.0:1789762978.423390:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b32c5c08000/f07ac6c5-9215-4651-bbbc-5b452d5bdd86 for lustre-OST0001 00000020:00000080:0.0:1789762978.423442:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b32c5c0d800 for lustre-OST0001 00000100:00100000:2.0:1789762978.426993:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2353:x1876702246690304:12345-192.168.203.36@tcp:4:dd.500 Request processed in 21904us (22258us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789762978.427021:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 415 00000100:00100000:2.0:1789762978.427049:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280853411948 time 280842288054 state 0x2 ref 0 00002000:00100000:2.0:1789762978.427083:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->4194303) req@ffff9b32c4def100 x1876702246690304/t4294967338(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762978.427105:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4def100 with x1876702246690304 ext(0->4194303) 00002000:00010000:2.0:1789762978.427117:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4def100 00000100:00100000:1.0:1789762978.462335:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.462401:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246690432 00000100:00100000:3.0:1789762978.462412:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246690432 00002000:00100000:3.0:1789762978.462460:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (4194304->8388607) req@ffff9b32c4dece00 x1876702246690432/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789762978.462472:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dece00 with x1876702246690432 ext(4194304->8388607) 00002000:00010000:3.0:1789762978.462478:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4dece00 00000100:00100000:3.0:1789762978.462508:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280853411948 time 280842288054 state 0x0 ref 1 00000100:00100000:3.0:1789762978.462523:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280892288054 time 280842288054 state 0x1 ref 1 00000100:00100000:3.0:1789762978.462556:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280892288054 time 280899798107 state 0x0 ref 1 00000100:00100000:3.0:1789762978.462573:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2356:x1876702246690432:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762978.478176:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2356:x1876702246690432:12345-192.168.203.36@tcp:4:dd.500 Request processed in 15602us (15858us total) trans 4294967744 rc 0/0 00000100:00100000:2.0:1789762978.478187:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 416 00000100:00100000:2.0:1789762978.478196:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280892288054 time 280899798107 state 0x2 ref 0 00002000:00100000:2.0:1789762978.478207:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (4194304->8388607) req@ffff9b32c4dece00 x1876702246690432/t4294967744(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762978.478215:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dece00 with x1876702246690432 ext(4194304->8388607) 00002000:00010000:2.0:1789762978.478220:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4dece00 00000100:00100000:1.0:1789762978.523899:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.523958:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246690816 00000100:00100000:3.0:1789762978.523968:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246690816 00000100:00100000:3.0:1789762978.524014:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:3.0:1789762978.524022:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13463:x1876702246690816:12345-192.168.203.36@tcp:35:dd.500 00000100:00100000:3.0:1789762978.524266:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:13463:x1876702246690816:12345-192.168.203.36@tcp:35:dd.500 Request processed in 243us (375us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789762978.524274:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:1.0:1789762978.525418:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762978.525469:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246690560 00000100:00100000:0.0:1789762978.525474:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246690560 00002000:00100000:0.0:1789762978.525502:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xb:0x0] (4194304->8388607) req@ffff9b32c4dee300 x1876702246690560/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789762978.525511:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dee300 with x1876702246690560 ext(4194304->8388607) 00002000:00010000:0.0:1789762978.525515:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4dee300 00000100:00100000:0.0:1789762978.525528:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280892288054 time 280899798107 state 0x0 ref 1 00000100:00100000:0.0:1789762978.525538:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280949798107 time 280899798107 state 0x1 ref 1 00000100:00100000:0.0:1789762978.525560:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280949798107 time 280962805243 state 0x0 ref 1 00000100:00100000:0.0:1789762978.525568:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+8:2355:x1876702246690560:12345-192.168.203.36@tcp:4:dd.500 00000100:00100000:2.0:1789762978.540021:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246690560:12345-192.168.203.36@tcp:4:dd.500 Request processed in 14446us (14597us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1789762978.540031:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 417 00000100:00100000:2.0:1789762978.540041:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280949798107 time 280962805243 state 0x2 ref 0 00002000:00100000:2.0:1789762978.540052:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xb:0x0] (4194304->8388607) req@ffff9b32c4dee300 x1876702246690560/t4294967339(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789762978.540060:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dee300 with x1876702246690560 ext(4194304->8388607) 00002000:00010000:2.0:1789762978.540065:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4dee300 00000100:00100000:0.0:1789762978.569087:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.569147:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691072 00000100:00100000:2.0:1789762978.569156:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691072 00000100:00100000:2.0:1789762978.569202:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 249 00000100:00100000:2.0:1789762978.569210:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:13474:x1876702246691072:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762978.569231:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.569245:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5bc17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449ac expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569356:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569369:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569379:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569392:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569400:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569407:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789762978.569649:0:12191:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc:0x0], index 1: 0 00000004:00080000:2.0:1789762978.569654:0:12191:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:2.0:1789762978.569781:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5bc2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569792:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5bc2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569801:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5bc2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569831:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569841:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569846:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569850:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0cef800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.569853:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569858:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569867:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:2.0:1789762978.569870:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.569873:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569877:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bc1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762978.569887:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d52b312 reply state 00000000e22109ea transno 4294967498 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762978.569896:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789762978.569924:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5bc17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449ac expref: 18 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569941:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5bc2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449ac expref: 17 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.569955:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b33ed2aaa00) 00010000:00010000:2.0:1789762978.569957:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762978.569959:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cee000, rc 0) 00000100:00100000:2.0:1789762978.570005:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+18:13474:x1876702246691072:12345-192.168.203.36@tcp:101:dd.0 Request processed in 796us (925us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789762978.570011:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 249 00010000:00010000:2.0:1789762978.570845:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.570852:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.570856:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.570859:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f0ceec00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.570862:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.570866:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.570873:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x25a23cf0 (ffff9b33ed2aa500) 00010000:00010000:2.0:1789762978.570875:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.570877:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.570881:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0ceec00/0x5915dfb1c1b5bc25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762978.577420:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.577468:0:12943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691200 00000100:00100000:3.0:1789762978.577475:0:12943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691200 00000100:00100000:3.0:1789762978.577575:0:12943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:3.0:1789762978.577586:0:12943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:13474:x1876702246691200:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1789762978.577596:0:12943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.577609:0:12943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c095dc5b/0x5915dfb1c1b5bc3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449b3 expref: -99 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789762978.577629:0:12943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789762978.577643:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789762978.577648:0:12943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762978.577665:0:12943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c095dc5b/0x5915dfb1c1b5bc3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449b3 expref: 11 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.577682:0:12943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c095dc5b/0x5915dfb1c1b5bc3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449b3 expref: 11 pid: 12943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.577693:0:12943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54be00, rc 0) 00000100:00100000:3.0:1789762978.577727:0:12943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13474:x1876702246691200:12345-192.168.203.36@tcp:101:dd.0 Request processed in 144us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762978.577735:0:12943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:1.0:1789762978.597338:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.597388:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691328 00000100:00100000:2.0:1789762978.597398:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691328 00000100:00100000:2.0:1789762978.597443:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:2.0:1789762978.597451:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:13479:x1876702246691328:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762978.597463:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.597475:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5bc41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449ba expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789762978.597492:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789762978.597504:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=281s v=(0 0) 00010000:00010000:2.0:1789762978.597507:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762978.597513:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5bc41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449ba expref: 11 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.597525:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a7764/0x5915dfb1c1b5bc41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449ba expref: 11 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.597533:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0ceec00, rc 0) 00000100:00100000:2.0:1789762978.597567:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:13479:x1876702246691328:12345-192.168.203.36@tcp:101:dd.0 Request processed in 118us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762978.597572:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:2.0:1789762978.618934:0:3420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b32c3cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254939008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789762978.618996:0:3420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789762978.619036:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702254939008 00000100:00100000:0.0:1789762978.619043:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702254939008 00000100:00080000:1.0:1789762978.619084:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789762978.619097:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789762978.619108:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254939008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789762978.619126:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 493355584 pending 8437760 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789762978.619166:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1876702254939008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762978.619173:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789762978.619204:0:3420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b32c3cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1876702254939008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789762978.640394:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762978.640440:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691456 00000100:00100000:0.0:1789762978.640454:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691456 00000100:00100000:0.0:1789762978.640493:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:0.0:1789762978.640502:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:5888:x1876702246691456:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789762978.640512:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789762978.640528:0:5910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789762978.640531:0:5910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1789762978 00002000:00010000:0.0:1789762978.640532:0:5910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1789762978 00002000:00010000:0.0:1789762978.640534:0:5910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:0.0:1789762978.640553:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81fe260/0x5915dfb1c1b5bc10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449a5 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.640573:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762978.640615:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:5888:x1876702246691456:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762978.640624:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:0.0:1789762978.649836:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.649896:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691584 00000100:00100000:1.0:1789762978.649904:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691584 00000100:00100000:1.0:1789762978.649945:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:1.0:1789762978.649952:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:5430:x1876702246691584:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762978.649963:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789762978.649976:0:5911:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:1.0:1789762978.649979:0:5911:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 0 -> 1789762978 00002000:00010000:1.0:1789762978.649981:0:5911:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 0 -> 1789762978 00002000:00010000:1.0:1789762978.649983:0:5911:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 0 -> 16384 00010000:00010000:1.0:1789762978.650002:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b234d3/0x5915dfb1c1b5bc02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894499e expref: 11 pid: 7959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.650025:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762978.650068:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:5430:x1876702246691584:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762978.650073:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00010000:00010000:2.0:1789762978.682915:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789762978.732338:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.732424:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691712 00000100:00100000:3.0:1789762978.732434:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691712 00002000:00100000:3.0:1789762978.732476:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc:0x0] (0->4194303) req@ffff9b32c4dec380 x1876702246691712/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762978.732485:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dec380 with x1876702246691712 ext(0->4194303) 00002000:00010000:3.0:1789762978.732490:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4dec380 00000100:00100000:3.0:1789762978.732503:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261210095659 time 261210151795 state 0x0 ref 1 00000100:00100000:3.0:1789762978.732509:0:12138:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 6: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2500 gen 0 rate 20 depth 3 token 0 deadline 261210095659 time 261210151795 state 0x0 ref 1 00000100:00100000:3.0:1789762978.732536:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 3 deadline 281169877376 time 281169777376 state 0x1 ref 1 00000100:00100000:3.0:1789762978.732557:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281169877376 time 281169802478 state 0x0 ref 1 00000100:00100000:3.0:1789762978.732566:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2355:x1876702246691712:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:3.0:1789762978.745721:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2355:x1876702246691712:12345-192.168.203.36@tcp:4:dd.0 Request processed in 13149us (13398us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789762978.745733:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 418 00000100:00100000:3.0:1789762978.745745:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281169877376 time 281169802478 state 0x2 ref 0 00002000:00100000:3.0:1789762978.745780:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc:0x0] (0->4194303) req@ffff9b32c4dec380 x1876702246691712/t4294967340(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789762978.745790:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dec380 with x1876702246691712 ext(0->4194303) 00002000:00010000:3.0:1789762978.745794:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4dec380 00000100:00100000:1.0:1789762978.789398:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.789466:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691840 00000100:00100000:2.0:1789762978.789476:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691840 00002000:00100000:2.0:1789762978.789516:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (4194304->8388607) req@ffff9b32c4deea00 x1876702246691840/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762978.789525:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4deea00 with x1876702246691840 ext(4194304->8388607) 00002000:00010000:2.0:1789762978.789529:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4deea00 00000100:00100000:2.0:1789762978.789543:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281169877376 time 281169802478 state 0x0 ref 1 00000100:00100000:2.0:1789762978.789554:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281169902478 time 281169802478 state 0x1 ref 1 00000100:00100000:2.0:1789762978.789580:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281169902478 time 281226825336 state 0x0 ref 1 00000100:00100000:2.0:1789762978.789590:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+12:2353:x1876702246691840:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:2.0:1789762978.800362:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.800826:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246691968 00000100:00100000:2.0:1789762978.800836:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246691968 00002000:00100000:2.0:1789762978.800880:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (4194304->8388607) req@ffff9b33ffd82d80 x1876702246691968/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762978.800893:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ffd82d80 with x1876702246691968 ext(4194304->8388607) 00002000:00010000:2.0:1789762978.800899:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ffd82d80 00000100:00100000:2.0:1789762978.800921:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281226925336 time 281226825336 state 0x1 ref 2 00000100:00100000:2.0:1789762978.800953:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281226925336 time 281238196016 state 0x0 ref 2 00000100:00100000:2.0:1789762978.800972:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+10:2353:x1876702246691968:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:1.0:1789762978.802698:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762978.802782:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246692096 00000100:00100000:0.0:1789762978.802790:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246692096 00002000:00100000:0.0:1789762978.802818:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (0->4194303) req@ffff9b32c4dec000 x1876702246692096/t0(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762978.802830:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dec000 with x1876702246692096 ext(0->4194303) 00002000:00010000:0.0:1789762978.802835:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4dec000 00000100:00100000:0.0:1789762978.802849:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281238296016 time 281238196016 state 0x1 ref 3 00000100:00100000:3.0:1789762978.802899:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281238296016 time 281240139555 state 0x0 ref 3 00000100:00100000:3.0:1789762978.802914:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+11:2354:x1876702246692096:12345-192.168.203.36@tcp:4:dd.0 00000100:00100000:1.0:1789762978.809091:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.809146:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246692352 00000100:00100000:2.0:1789762978.809152:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246692352 00000100:00100000:2.0:1789762978.809192:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 250 00000100:00100000:2.0:1789762978.809202:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+17:13515:x1876702246692352:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762978.809221:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.809237:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5bc48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449c1 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.809337:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5bc4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.809349:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.809359:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762978.809368:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:2.0:1789762978.809457:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5bc48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449c1 expref: 20 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.809471:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5bc4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449c1 expref: 19 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.809478:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762978.809480:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789762978.809487:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef200, rc 0) 00000100:00100000:2.0:1789762978.809520:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:13515:x1876702246692352:12345-192.168.203.36@tcp:101:dd.0 Request processed in 321us (435us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789762978.809526:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 250 00000100:00100000:0.0:1789762978.811694:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.811731:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246692608 00000100:00100000:1.0:1789762978.811738:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246692608 00000100:00100000:1.0:1789762978.811810:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 251 00000100:00100000:1.0:1789762978.811821:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+19:13514:x1876702246692608:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762978.811834:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762978.811846:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c000/0x5915dfb1c1b5bc5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449c8 expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.811914:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5bc64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.811923:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5bc64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.811931:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5bc64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762978.811937:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:1.0:1789762978.811992:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c000/0x5915dfb1c1b5bc5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449c8 expref: 22 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.812004:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5bc64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449c8 expref: 21 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.812010:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:1.0:1789762978.812013:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762978.812015:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767c400, rc 0) 00000100:00100000:1.0:1789762978.812054:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+21:13514:x1876702246692608:12345-192.168.203.36@tcp:101:dd.0 Request processed in 236us (363us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789762978.812064:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 251 00000100:00100000:2.0:1789762978.814116:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246691840:12345-192.168.203.36@tcp:4:dd.0 Request processed in 24525us (24726us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789762978.814125:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 419 00002000:00100000:2.0:1789762978.814134:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (4194304->8388607) req@ffff9b32c4deea00 x1876702246691840/t4294967341(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762978.814142:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4deea00 with x1876702246691840 ext(4194304->8388607) 00002000:00010000:2.0:1789762978.814147:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b32c4deea00 00000100:00100000:2.0:1789762978.814887:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:2353:x1876702246691968:12345-192.168.203.36@tcp:4:dd.0 Request processed in 13917us (14530us total) trans 4294967745 rc 0/0 00000100:00100000:2.0:1789762978.814893:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 420 00002000:00100000:2.0:1789762978.814899:0:6916:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (4194304->8388607) req@ffff9b33ffd82d80 x1876702246691968/t4294967745(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789762978.814905:0:6916:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b33ffd82d80 with x1876702246691968 ext(4194304->8388607) 00002000:00010000:2.0:1789762978.814909:0:6916:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b33ffd82d80 00000100:00100000:2.0:1789762978.819215:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.819260:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.819260:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246692864 00000100:00100000:3.0:1789762978.819277:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246692864 00000100:00100000:2.0:1789762978.819303:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.819342:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246693120 00000100:00100000:1.0:1789762978.819353:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246693120 00000100:00100000:2.0:1789762978.819357:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246693376 00000100:00100000:3.0:1789762978.819369:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 252 00000100:00100000:2.0:1789762978.819370:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246693376 00000100:00100000:3.0:1789762978.819390:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:13512:x1876702246692864:12345-192.168.203.36@tcp:101:dd.0 00000100:00100000:1.0:1789762978.819409:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00010000:00010000:3.0:1789762978.819414:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789762978.819419:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 253 00000100:00100000:1.0:1789762978.819424:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0af9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:13483:x1876702246693120:12345-192.168.203.36@tcp:35:dd.0 00010000:00010000:3.0:1789762978.819433:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bc72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449cf expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762978.819434:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+23:13516:x1876702246693376:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762978.819457:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.819470:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bc79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449d6 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.819529:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bc80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.819540:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bc80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.819550:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bc80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762978.819558:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:3.0:1789762978.819569:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a200/0x5915dfb1c1b5bc87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789762978.819577:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00010000:00010000:3.0:1789762978.819583:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a200/0x5915dfb1c1b5bc87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.819608:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a200/0x5915dfb1c1b5bc87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.819627:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:2.0:1789762978.819633:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee600/0x5915dfb1c1b5bc79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449d6 expref: 29 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.819658:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bc80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449d6 expref: 28 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762978.819660:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0af9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:13483:x1876702246693120:12345-192.168.203.36@tcp:35:dd.0 Request processed in 241us (397us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789762978.819675:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00010000:00010000:2.0:1789762978.819675:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762978.819679:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762978.819682:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef000, rc 0) 00000020:00080000:1.0:1789762978.819690:0:5928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789762978.819708:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:13516:x1876702246693376:12345-192.168.203.36@tcp:101:dd.0 Request processed in 277us (404us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789762978.819716:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 253 00010000:00010000:3.0:1789762978.819788:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54ac00/0x5915dfb1c1b5bc72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449cf expref: 28 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.819806:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a200/0x5915dfb1c1b5bc87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449cf expref: 27 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762978.819820:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1789762978.819833:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:3.0:1789762978.819837:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789762978.819840:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54a200, rc 0) 00000100:00100000:2.0:1789762978.819894:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246693632 00000100:00100000:2.0:1789762978.819899:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246693632 00000100:00100000:2.0:1789762978.819944:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 254 00000100:00100000:2.0:1789762978.819961:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:13517:x1876702246693632:12345-192.168.203.36@tcp:101:dd.0 00000100:00100000:3.0:1789762978.819967:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+28:13512:x1876702246692864:12345-192.168.203.36@tcp:101:dd.0 Request processed in 582us (749us total) trans 4294967504 rc 0/0 00010000:00010000:2.0:1789762978.819986:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789762978.819986:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 252 00010000:00010000:2.0:1789762978.820004:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5bc9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449dd expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.820049:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bca3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.820057:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.820064:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762978.820070:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:2.0:1789762978.820130:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee200/0x5915dfb1c1b5bc9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449dd expref: 30 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.820142:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449dd expref: 29 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.820148:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762978.820150:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762978.820152:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f0cef800, rc 0) 00000100:00100000:2.0:1789762978.820189:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:13517:x1876702246693632:12345-192.168.203.36@tcp:101:dd.0 Request processed in 238us (381us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789762978.820195:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 254 00000100:00100000:1.0:1789762978.820385:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.820414:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.820420:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246693888 00000100:00100000:2.0:1789762978.820430:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246693888 00000100:00100000:1.0:1789762978.820445:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.820471:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246694272 00000100:00100000:3.0:1789762978.820479:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246694272 00000100:00100000:1.0:1789762978.820480:0:12136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246694400 00000100:00100000:2.0:1789762978.820480:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 255 00000100:00100000:1.0:1789762978.820488:0:12136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246694400 00000100:00100000:2.0:1789762978.820494:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:13513:x1876702246693888:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1789762978.820504:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.820515:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031a00/0x5915dfb1c1b5bcb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449e4 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762978.820526:0:12136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:1.0:1789762978.820535:0:12136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33fc730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+14:13514:x1876702246694400:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:1.0:1789762978.820544:0:12136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.820555:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b5bcb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.820562:0:12136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5bcbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449eb expref: -99 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.820566:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b5bcb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762978.820582:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:3.0:1789762978.820600:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:13515:x1876702246694272:12345-192.168.203.36@tcp:35:dd.0 00010000:00010000:2.0:1789762978.820603:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b5bcb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789762978.820608:0:12136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 8388608, mtime: 0x6aad9da2, atime: 0x0, ctime: 0x6aad9da2, blocks: 0x4000 00000004:00200000:2.0:1789762978.820622:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 16777216 00010000:00010000:1.0:1789762978.820626:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=281s v=(0 0) 00010000:00010000:1.0:1789762978.820631:0:12136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762978.820639:0:12136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5bcbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449eb expref: 15 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.820650:0:12136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdd1c8c5/0x5915dfb1c1b5bcbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449eb expref: 15 pid: 12136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.820659:0:12136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767c800, rc 0) 00000100:00100000:1.0:1789762978.820690:0:12136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33fc730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:13514:x1876702246694400:12345-192.168.203.36@tcp:101:dd.0 Request processed in 155us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1789762978.820692:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031a00/0x5915dfb1c1b5bcb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449e4 expref: 33 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762978.820709:0:12136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 129 00010000:00010000:2.0:1789762978.820711:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b5bcb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449e4 expref: 32 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.820718:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762978.820721:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789762978.820723:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33c0031800, rc 0) 00000100:00100000:3.0:1789762978.820735:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.820784:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:13513:x1876702246693888:12345-192.168.203.36@tcp:101:dd.0 Request processed in 289us (397us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789762978.820791:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 255 00000100:00100000:2.0:1789762978.820851:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246694528 00000100:00100000:2.0:1789762978.820857:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246694528 00000100:00100000:3.0:1789762978.820868:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.820915:0:7992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246694016 00000100:00100000:2.0:1789762978.820921:0:7992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246694016 00000100:00100000:0.0:1789762978.820943:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1789762978.820964:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:2355:x1876702246694528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789762978.820976:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00010000:00010000:0.0:1789762978.820977:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789762978.820987:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:2353:x1876702246694016:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762978.820997:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762978.821000:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef200/0x5915dfb1c1b5bc4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449c1 expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.821016:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c400/0x5915dfb1c1b5bc64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449c8 expref: 32 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.821026:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:0.0:1789762978.821033:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789762978.821034:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:1.0:1789762978.821040:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789762978.821080:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:2355:x1876702246694528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 117us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762978.821082:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:2353:x1876702246694016:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762978.821082:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:13515:x1876702246694272:12345-192.168.203.36@tcp:35:dd.0 Request processed in 483us (664us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789762978.821101:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:2.0:1789762978.821106:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:1.0:1789762978.821114:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:3.0:1789762978.821464:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.821499:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246694656 00000100:00100000:1.0:1789762978.821504:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246694656 00000100:00100000:1.0:1789762978.821532:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:1.0:1789762978.821538:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33d8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:2356:x1876702246694656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789762978.821544:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789762978.821552:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a200/0x5915dfb1c1b5bc87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449cf expref: 30 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.821562:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:1.0:1789762978.821564:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762978.821590:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33d8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:2356:x1876702246694656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762978.821596:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1789762978.822784:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2354:x1876702246692096:12345-192.168.203.36@tcp:4:dd.0 Request processed in 19870us (20083us total) trans 4294967746 rc 0/0 00000100:00100000:0.0:1789762978.822796:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 421 00000100:00100000:0.0:1789762978.822808:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c2df9000 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281238296016 time 281240139555 state 0x2 ref 0 00002000:00100000:0.0:1789762978.822822:0:12139:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xf:0x0] (0->4194303) req@ffff9b32c4dec000 x1876702246692096/t4294967746(0) o4->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/448 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762978.822832:0:12139:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c4dec000 with x1876702246692096 ext(0->4194303) 00002000:00010000:0.0:1789762978.822837:0:12139:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c4dec000 00000100:00100000:3.0:1789762978.826303:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.826339:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.826367:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246694912 00000100:00100000:3.0:1789762978.826375:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.826377:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246694912 00000100:00100000:2.0:1789762978.826404:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246695040 00000100:00100000:2.0:1789762978.826411:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246695040 00000100:00100000:1.0:1789762978.826418:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:1.0:1789762978.826427:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:13517:x1876702246694912:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:0.0:1789762978.826447:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246695168 00000100:00100000:0.0:1789762978.826454:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246695168 00000100:00100000:2.0:1789762978.826472:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1789762978.826489:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:2354:x1876702246695040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1789762978.826493:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xe:0x0] (0->1048575) req@ffff9b32c2388e00 x1876702246695168/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/0 e 0 to 0 dl 1789762989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1789762978.826501:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1789762978.826508:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c2388e00 with x1876702246695168 ext(0->1048575) 00002000:00010000:0.0:1789762978.826514:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c2388e00 00010000:00010000:2.0:1789762978.826519:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef800/0x5915dfb1c1b5bca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449dd expref: 31 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.826534:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762978.826541:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762978.826543:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:13517:x1876702246694912:12345-192.168.203.36@tcp:35:dd.0 Request processed in 115us (239us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789762978.826547:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270985892691 time 270986037153 state 0x0 ref 1 00000100:00100000:1.0:1789762978.826553:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:0.0:1789762978.826567:0:12138:0:(nrs_tbf.c:2662:nrs_tbf_res_get()) ost_io.0 NRS: TBF rule update, rule flags 0x1, head sequence 6: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2900 gen 0 rate 10 depth 3 token 0 deadline 270985892691 time 270986037153 state 0x0 ref 1 00000100:00100000:2.0:1789762978.826584:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:2354:x1876702246695040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762978.826593:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:0.0:1789762978.826632:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 3 deadline 281263969062 time 281263869062 state 0x1 ref 1 00000100:00100000:0.0:1789762978.826665:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281263969062 time 281263907575 state 0x0 ref 1 00000100:00100000:0.0:1789762978.826679:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2353:x1876702246695168:12345-192.168.203.36@tcp:3:dd.0 00000100:00100000:3.0:1789762978.829501:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.829524:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.829561:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246695296 00000100:00100000:1.0:1789762978.829569:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246695296 00000100:00100000:2.0:1789762978.829570:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246695552 00000100:00100000:2.0:1789762978.829576:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246695552 00000100:00100000:1.0:1789762978.829614:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:1.0:1789762978.829628:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:2355:x1876702246695296:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789762978.829628:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 79 00010000:00010000:1.0:1789762978.829639:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789762978.829646:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:13512:x1876702246695552:12345-192.168.203.36@tcp:35:dd.0 00010000:00010000:1.0:1789762978.829652:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33c0031800/0x5915dfb1c1b5bcb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449e4 expref: 30 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.829665:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:1.0:1789762978.829668:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789762978.829696:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:2355:x1876702246695296:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762978.829705:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:2.0:1789762978.829788:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:13512:x1876702246695552:12345-192.168.203.36@tcp:35:dd.0 Request processed in 110us (224us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789762978.829795:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:0.0:1789762978.830690:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2353:x1876702246695168:12345-192.168.203.36@tcp:3:dd.0 Request processed in 4013us (4316us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789762978.830701:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 422 00000100:00100000:0.0:1789762978.830709:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b32c4e29a00 key jobid={dd.0}&nid={192.168.203.36@tcp}&opcode={ost_read}&uid={0}&gid={0}&projid={0}&nodemap={-1} rule@0xffff9b33f46d3000 gen 0 rate 10000 depth 3 token 2 deadline 281263969062 time 281263907575 state 0x2 ref 0 00002000:00100000:0.0:1789762978.830721:0:12138:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xe:0x0] (0->1048575) req@ffff9b32c2388e00 x1876702246695168/t0(0) o3->f07ac6c5-9215-4651-bbbc-5b452d5bdd86@192.168.203.36@tcp:4/0 lens 488/440 e 0 to 0 dl 1789762989 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789762978.830731:0:12138:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b32c2388e00 with x1876702246695168 ext(0->1048575) 00002000:00010000:0.0:1789762978.830735:0:12138:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b32c2388e00 00000100:00100000:2.0:1789762978.835380:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.835412:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246695808 00000100:00100000:1.0:1789762978.835418:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246695808 00000100:00100000:1.0:1789762978.835446:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:1.0:1789762978.835452:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+29:13516:x1876702246695808:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:1.0:1789762978.835534:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:13516:x1876702246695808:12345-192.168.203.36@tcp:35:dd.0 Request processed in 81us (155us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1789762978.835549:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:3.0:1789762978.848590:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.848635:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246696064 00000100:00100000:2.0:1789762978.848646:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246696064 00000100:00100000:2.0:1789762978.848687:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:2.0:1789762978.848694:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+30:13513:x1876702246696064:12345-192.168.203.36@tcp:35:dd.0 00000100:00100000:2.0:1789762978.848847:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:13513:x1876702246696064:12345-192.168.203.36@tcp:35:dd.0 Request processed in 152us (264us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1789762978.848853:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:3.0:1789762978.882443:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.882524:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246696192 00000100:00100000:1.0:1789762978.882537:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246696192 00000100:00100000:1.0:1789762978.882594:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 256 00000100:00100000:1.0:1789762978.882604:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+31:13526:x1876702246696192:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:1.0:1789762978.882625:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762978.882641:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c000/0x5915dfb1c1b5bccd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449f2 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.882693:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5bcd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.882704:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5bcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.882716:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5bcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789762978.882783:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00000004:00200000:1.0:1789762978.882787:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789762978.882804:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5bcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.882832:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767c000/0x5915dfb1c1b5bccd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449f2 expref: 33 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.882851:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5bcd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449f2 expref: 32 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762978.882897:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:1.0:1789762978.882901:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789762978.882905:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767ce00, rc 0) 00000100:00100000:1.0:1789762978.882961:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:13526:x1876702246696192:12345-192.168.203.36@tcp:101:rm.0 Request processed in 359us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789762978.882966:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 256 00000100:00100000:1.0:1789762978.884156:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.884202:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246696448 00000100:00100000:3.0:1789762978.884211:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246696448 00000100:00100000:3.0:1789762978.884256:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 257 00000100:00100000:3.0:1789762978.884265:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+32:13526:x1876702246696448:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1789762978.884282:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762978.884296:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bcdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b8789449f9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762978.884391:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00010000:00010000:3.0:1789762978.884483:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bcdb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449f9 expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.884496:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92e00) 00010000:00010000:3.0:1789762978.884498:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762978.884501:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bcdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449f9 expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.884512:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54b200, rc 0) 00000100:00100000:3.0:1789762978.884557:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:13526:x1876702246696448:12345-192.168.203.36@tcp:101:rm.0 Request processed in 294us (403us total) trans 4294967512 rc 301/301 00000100:00100000:3.0:1789762978.884563:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 257 00000100:00100000:3.0:1789762978.885973:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762978.886010:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246696576 00000100:00100000:1.0:1789762978.886016:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246696576 00000100:00100000:1.0:1789762978.886048:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:1.0:1789762978.886055:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33e0afb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:13526:x1876702246696576:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:2.0:1789762978.887964:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33e0afb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:13526:x1876702246696576:12345-192.168.203.36@tcp:37:rm.0 Request processed in 1906us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762978.887975:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:2.0:1789762978.889348:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762978.889391:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246696832 00000100:00100000:3.0:1789762978.889397:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246696832 00000100:00100000:3.0:1789762978.889439:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:3.0:1789762978.889445:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+33:13526:x1876702246696832:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:3.0:1789762978.889555:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:13526:x1876702246696832:12345-192.168.203.36@tcp:35:rm.0 Request processed in 109us (208us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1789762978.889561:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:3.0:1789762978.890525:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.890572:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246697088 00000100:00100000:2.0:1789762978.890578:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246697088 00000100:00100000:2.0:1789762978.890613:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 258 00000100:00100000:2.0:1789762978.890621:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:13526:x1876702246697088:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:2.0:1789762978.890635:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762978.890648:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a00 expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.890704:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bcf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.890713:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.890719:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762978.890740:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00010000:00010000:2.0:1789762978.890845:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a00 expref: 37 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.890856:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a00 expref: 36 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.890862:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:2.0:1789762978.890864:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789762978.890866:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460200, rc 0) 00000100:00100000:2.0:1789762978.890905:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246697088:12345-192.168.203.36@tcp:101:rm.0 Request processed in 284us (379us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789762978.890913:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 258 00000100:00100000:1.0:1789762978.891800:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.891828:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246697216 00000100:00100000:2.0:1789762978.891833:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246697216 00000100:00100000:2.0:1789762978.891858:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 259 00000100:00100000:2.0:1789762978.891863:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246697216:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:2.0:1789762978.891896:0:7598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7375855616 00000100:00100000:2.0:1789762978.891934:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246697216:12345-192.168.203.36@tcp:41:rm.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762978.891942:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 259 00000100:00100000:1.0:1789762978.892743:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.892809:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246697472 00000100:00100000:2.0:1789762978.892813:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246697472 00000100:00100000:2.0:1789762978.892839:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1789762978.892845:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246697472:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762978.892953:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:13526:x1876702246697472:12345-192.168.203.36@tcp:35:rm.0 Request processed in 106us (211us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789762978.892962:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:3.0:1789762978.893648:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.893686:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246697728 00000100:00100000:2.0:1789762978.893691:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246697728 00000100:00100000:2.0:1789762978.893717:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 260 00000100:00100000:2.0:1789762978.893723:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:13526:x1876702246697728:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762978.893790:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762978.893809:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cef000/0x5915dfb1c1b5bc80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449d6 expref: 37 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893824:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a400/0x5915dfb1c1b5bbf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944997 expref: 36 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893832:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33fec92f00) 00010000:00010000:2.0:1789762978.893841:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767ce00/0x5915dfb1c1b5bcd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449f2 expref: 35 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893847:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:2.0:1789762978.893849:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762978.893858:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893865:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893872:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893895:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893904:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893912:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893975:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893984:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.893992:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789762978.894163:0:9183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:2.0:1789762978.894174:0:9183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 281331421858ns, next at 282331419297ns, rc = 0 00000040:00080000:2.0:1789762978.894202:0:9183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 64 off8896 00000004:00080000:2.0:1789762978.894209:0:9183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 281331457903ns, next at 282331456502ns, rc = 0 00010000:00010000:2.0:1789762978.894236:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894243:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894249:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894262:0:9183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894268:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894274:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894294:0:9183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789762978.894308:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894329:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894337:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894342:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762978.894342:0:8854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789762978.894354:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.894356:0:8854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894365:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.894368:0:8854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461c00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762978.894379:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33ed2aad00) 00010000:00010000:3.0:1789762978.894380:0:8854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894392:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762978.894401:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.894404:0:8854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.894423:0:8854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b33ed2aad00) 00010000:00010000:2.0:1789762978.894424:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461000/0x5915dfb1c1b5bd0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.894435:0:8854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789762978.894444:0:8854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.894450:0:8854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461c00/0x5915dfb1c1b5bd13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894454:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894461:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894466:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894470:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.894473:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.894474:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762978.894477:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762978.894483:0:8854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789762978.894485:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894494:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:2.0:1789762978.894495:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.894497:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.894501:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bcfe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762978.894508:0:9183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000515f5f5f reply state 000000007cb61354 transno 4294967516 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762978.894514:0:9183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762978.894553:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246697728:12345-192.168.203.36@tcp:36:rm.0 Request processed in 830us (908us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789762978.894558:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 260 00010000:00010000:2.0:1789762978.895240:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.895247:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.895251:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.895254:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.895257:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.895261:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.895268:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x3950208a (ffff9b33ed2aa000) 00010000:00010000:2.0:1789762978.895270:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.895273:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.895279:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x3950208a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762978.896584:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762978.896679:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246697984 00000100:00100000:0.0:1789762978.896686:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246697984 00000100:00100000:0.0:1789762978.896721:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 261 00000100:00100000:0.0:1789762978.896728:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13526:x1876702246697984:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1789762978.896776:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789762978.896796:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cee000/0x5915dfb1c1b5bc2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b8789449ac expref: 35 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896808:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b33ed2aaa00) 00010000:00010000:0.0:1789762978.896813:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762978.896822:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896829:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896835:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896843:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896848:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896853:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896885:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896890:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.896894:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789762978.896975:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 64 off8960 00000040:00080000:0.0:1789762978.896993:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00010000:00010000:0.0:1789762978.897016:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897023:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897028:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897033:0:5924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897036:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897040:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897055:0:5924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789762978.897062:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897067:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897071:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897074:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762978.897076:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897080:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897091:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b33f721d500) 00010000:00010000:0.0:1789762978.897093:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789762978.897096:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897100:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd28 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897110:0:6926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789762978.897111:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897123:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897123:0:6926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897166:0:6926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762978.897167:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897180:0:6926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897182:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762978.897190:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897201:0:6926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897202:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897250:0:6926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b33f721d500) 00010000:00010000:0.0:1789762978.897251:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:3.0:1789762978.897269:0:6926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789762978.897270:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762978.897293:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897293:0:6926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762978.897340:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897340:0:6926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897396:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789762978.897397:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b19c4fc6 reply state 00000000d1e67af5 transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762978.897399:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789762978.897401:0:6926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762978.897409:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789762978.897447:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246697984:12345-192.168.203.36@tcp:36:rm.0 Request processed in 719us (864us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789762978.897452:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 261 00010000:00010000:2.0:1789762978.897992:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.897999:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.898013:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.898016:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.898018:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.898023:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.898031:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x25a23cf0 (ffff9b33f721dd00) 00010000:00010000:2.0:1789762978.898033:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.898036:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.898043:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x25a23cf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762978.904065:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.904107:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246698240 00000100:00100000:2.0:1789762978.904111:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246698240 00000100:00100000:2.0:1789762978.904139:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:2.0:1789762978.904144:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13526:x1876702246698240:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1789762978.904220:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246698240:12345-192.168.203.36@tcp:35:rm.0 Request processed in 75us (159us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789762978.904225:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:1.0:1789762978.904954:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762978.904989:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246698496 00000100:00100000:2.0:1789762978.904994:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246698496 00000100:00100000:2.0:1789762978.905019:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 262 00000100:00100000:2.0:1789762978.905032:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13526:x1876702246698496:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:2.0:1789762978.905056:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789762978.905070:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bcf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a00 expref: 36 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905088:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f0cefa00/0x5915dfb1c1b5bbd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944990 expref: 35 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905096:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:2.0:1789762978.905105:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a000/0x5915dfb1c1b5bb76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b87894497b expref: 34 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905111:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33fec92e00) 00010000:00010000:2.0:1789762978.905115:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762978.905125:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905132:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905138:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905144:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905149:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905154:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905189:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905195:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905200:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762978.905296:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 4096 00010000:00010000:2.0:1789762978.905305:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905324:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905332:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905336:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.905339:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905343:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905349:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b33ed2aab00) 00010000:00010000:2.0:1789762978.905351:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789762978.905353:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905365:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905378:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905382:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905386:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905389:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.905391:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905395:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905399:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aae00) 00010000:00010000:2.0:1789762978.905401:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.905402:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.905406:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762978.905412:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000567d280f reply state 00000000b83f9b56 transno 4294967519 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762978.905416:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762978.905452:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13526:x1876702246698496:12345-192.168.203.36@tcp:36:rm.0 Request processed in 421us (500us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789762978.905457:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 262 00010000:00010000:2.0:1789762978.905996:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.906003:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.906007:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.906010:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762978.906012:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.906017:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.906023:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2aa700) 00010000:00010000:2.0:1789762978.906024:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762978.906026:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762978.906031:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461a00/0x5915dfb1c1b5bd3d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762979.191256:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762979.191297:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246698624 00000100:00100000:2.0:1789762979.191307:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246698624 00000100:00080000:1.0:1789762979.191360:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789762979.191392:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 263 00000100:00100000:2.0:1789762979.191403:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+34:13537:x1876702246698624:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:2.0:1789762979.191435:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762979.191457:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a07 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.191511:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.191522:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.191530:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762979.191564:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762979.191567:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762979.191595:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.191622:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a07 expref: 36 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.191640:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a07 expref: 35 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.191658:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aa700) 00010000:00010000:2.0:1789762979.191661:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762979.191665:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7461400, rc 0) 00000100:00100000:2.0:1789762979.191739:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13537:x1876702246698624:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 338us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762979.191773:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 263 00000100:00100000:1.0:1789762979.193176:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762979.193246:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246698880 00000100:00100000:2.0:1789762979.193253:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246698880 00000100:00100000:2.0:1789762979.193285:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 264 00000100:00100000:2.0:1789762979.193291:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13537:x1876702246698880:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:2.0:1789762979.193332:0:12191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762979.193346:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461400/0x5915dfb1c1b5bd52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a07 expref: 35 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193358:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aa700) 00010000:00010000:2.0:1789762979.193364:0:12191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762979.193398:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193406:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193412:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193430:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193435:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193440:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762979.193905:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 4096 00010000:00010000:2.0:1789762979.193915:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193937:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193957:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193961:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762979.193966:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193971:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193981:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aae00) 00010000:00010000:2.0:1789762979.193983:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762979.193986:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.193990:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bd59 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762979.194007:0:12191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c348a9ff reply state 000000003e7e87a3 transno 4294967520 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762979.194013:0:12191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789762979.194054:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13537:x1876702246698880:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 762us (878us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789762979.194063:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 264 00010000:00010000:2.0:1789762979.194668:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.194685:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.194689:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.194693:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762979.194695:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.194700:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.194709:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33ed2aab00) 00010000:00010000:2.0:1789762979.194711:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789762979.194713:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.194717:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bd60 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762979.199776:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762979.199803:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246699008 00000100:00100000:2.0:1789762979.199808:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246699008 00000100:00100000:2.0:1789762979.199851:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 265 00000100:00100000:2.0:1789762979.199859:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13538:x1876702246699008:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1789762979.199869:0:7598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789762979.199877:0:7598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a0e expref: -99 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.199930:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bd6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.199942:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.199952:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789762979.199970:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789762979.199973:0:7598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789762979.199983:0:7598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.199999:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7461800/0x5915dfb1c1b5bd67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a0e expref: 37 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.200009:0:7598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bd6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a0e expref: 36 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.200014:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:2.0:1789762979.200016:0:7598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789762979.200018:0:7598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f7460a00, rc 0) 00000100:00100000:2.0:1789762979.200047:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13538:x1876702246699008:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 190us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789762979.200053:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 265 00000100:00100000:1.0:1789762979.201075:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.201125:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246699264 00000100:00100000:0.0:1789762979.201133:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246699264 00000100:00100000:0.0:1789762979.201179:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 266 00000100:00100000:0.0:1789762979.201190:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13538:x1876702246699264:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1789762979.201199:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762979.201202:0:9183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789762979.201218:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460a00/0x5915dfb1c1b5bd6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a0e expref: 36 pid: 7598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201241:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33ed2aa200) 00010000:00010000:0.0:1789762979.201260:0:9183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789762979.201281:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bd75 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a15 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201372:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201383:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201392:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201417:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201426:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201437:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201490:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201499:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201508:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762979.201517:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 4096 00010000:00010000:0.0:1789762979.201528:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201536:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201543:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201549:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82c400 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762979.201553:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201575:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201585:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b33f721d000) 00010000:00010000:0.0:1789762979.201588:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762979.201593:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201600:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bd8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201624:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201631:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201638:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201644:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762979.201647:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201654:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201664:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d300) 00010000:00010000:0.0:1789762979.201667:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762979.201671:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201689:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bd7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201702:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201709:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201716:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201722:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762979.201726:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201732:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201743:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d200) 00010000:00010000:0.0:1789762979.201746:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762979.201782:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201791:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bd83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201833:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bd75 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a15 expref: 36 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201860:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d300) 00010000:00010000:0.0:1789762979.201863:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762979.201868:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bd75 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a15 expref: 36 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.201891:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82dc00, rc 0) 00000100:00100000:0.0:1789762979.201932:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13538:x1876702246699264:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 744us (859us total) trans 0 rc 301/301 00000100:00100000:0.0:1789762979.201940:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 266 00000100:00100000:1.0:1789762979.202711:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.202804:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246699392 00000100:00100000:0.0:1789762979.202811:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246699392 00000100:00100000:0.0:1789762979.202855:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 267 00000100:00100000:0.0:1789762979.202870:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c6b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+35:13538:x1876702246699392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1789762979.202881:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762979.202896:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a1c expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.202928:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.202939:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.202951:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762979.202973:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789762979.202984:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762979.203000:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.203022:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c800/0x5915dfb1c1b5bd91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a1c expref: 37 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.203038:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d200/0x5915dfb1c1b5bd98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a1c expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.203047:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d600) 00010000:00010000:0.0:1789762979.203050:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789762979.203054:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82d200, rc 0) 00000100:00100000:0.0:1789762979.203091:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c6b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13538:x1876702246699392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 227us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762979.203099:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 267 00000100:00100000:2.0:1789762979.204090:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762979.204125:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246699648 00000100:00100000:3.0:1789762979.204135:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246699648 00000100:00100000:3.0:1789762979.204182:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 268 00000100:00100000:3.0:1789762979.204194:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+36:13538:x1876702246699648:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1789762979.204209:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762979.204224:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b000/0x5915dfb1c1b5bd9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a23 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204290:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204301:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204309:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204336:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204342:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204348:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762979.204426:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 4096 00010000:00010000:3.0:1789762979.204482:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204488:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204492:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204496:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54b200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762979.204500:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204514:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204523:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d600) 00010000:00010000:3.0:1789762979.204525:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762979.204528:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204532:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bda6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204540:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204544:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204548:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204551:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54a600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762979.204553:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204557:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204562:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fec92400) 00010000:00010000:3.0:1789762979.204565:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762979.204567:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204578:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204608:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b000/0x5915dfb1c1b5bd9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a23 expref: 38 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204615:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d600) 00010000:00010000:3.0:1789762979.204617:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789762979.204620:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b000/0x5915dfb1c1b5bd9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a23 expref: 38 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.204627:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54b000, rc 0) 00000100:00100000:3.0:1789762979.204681:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:13538:x1876702246699648:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 492us (592us total) trans 4294967521 rc 301/301 00000100:00100000:3.0:1789762979.204687:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 268 00000100:00100000:3.0:1789762979.205574:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762979.205622:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246699904 00000100:00100000:2.0:1789762979.205635:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246699904 00000100:00100000:2.0:1789762979.205672:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 269 00000100:00100000:2.0:1789762979.205679:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+37:13538:x1876702246699904:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1789762979.205728:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.205738:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.205745:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762979.205864:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000671e5c6d reply state 00000000180ff5f0 transno 4294967522 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762979.205871:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762979.205878:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 4096 00000100:00100000:2.0:1789762979.205965:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c2389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+39:13538:x1876702246699904:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 282us (388us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789762979.205974:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 269 00010000:00010000:2.0:1789762979.206722:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.206730:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.206735:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.206740:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:2.0:1789762979.206743:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.206799:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.206809:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b33ed2aab00) 00010000:00010000:2.0:1789762979.206812:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789762979.206815:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.206820:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460600/0x5915dfb1c1b5bdbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762979.206845:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762979.206878:0:12131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246700160 00000100:00100000:2.0:1789762979.206883:0:12131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246700160 00000100:00100000:2.0:1789762979.206922:0:12131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:2.0:1789762979.206935:0:12131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+38:13538:x1876702246700160:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1789762979.207031:0:12131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c238ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+39:13538:x1876702246700160:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 101us (190us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789762979.207037:0:12131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:2.0:1789762979.210912:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762979.210959:0:12191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246700288 00000100:00100000:3.0:1789762979.210966:0:12191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246700288 00000100:00100000:3.0:1789762979.211013:0:12191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 270 00000100:00100000:3.0:1789762979.211027:0:12191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+39:13539:x1876702246700288:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:3.0:1789762979.211039:0:12191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789762979.211049:0:12191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b000/0x5915dfb1c1b5bdc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a2a expref: -99 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211099:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211112:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211119:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211129:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211134:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211139:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211172:0:12191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b600/0x5915dfb1c1b5bdd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211177:0:12191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b600/0x5915dfb1c1b5bdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211182:0:12191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b600/0x5915dfb1c1b5bdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789762979.211200:0:12191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 4096 00000004:00200000:3.0:1789762979.211202:0:12191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789762979.211213:0:12191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b600/0x5915dfb1c1b5bdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211220:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211233:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211237:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211241:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54a600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762979.211243:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211248:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211259:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d600) 00010000:00010000:3.0:1789762979.211261:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762979.211264:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211268:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54a600/0x5915dfb1c1b5bdc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211276:0:12191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211280:0:12191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211284:0:12191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211288:0:12191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54b200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:3.0:1789762979.211295:0:12191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211301:0:12191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211306:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33fec92400) 00010000:00010000:3.0:1789762979.211308:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789762979.211309:0:12191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211329:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b200/0x5915dfb1c1b5bdd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211354:0:12191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b000/0x5915dfb1c1b5bdc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a2a expref: 41 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211362:0:12191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b600/0x5915dfb1c1b5bdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a2a expref: 40 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.211367:0:12191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b33fec92100) 00010000:00010000:3.0:1789762979.211368:0:12191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789762979.211370:0:12191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff54b600, rc 0) 00000100:00100000:3.0:1789762979.211405:0:12191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:13539:x1876702246700288:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 385us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789762979.211410:0:12191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 270 00000100:00100000:3.0:1789762979.212413:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762979.212454:0:7598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246700544 00000100:00100000:2.0:1789762979.212460:0:7598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246700544 00000100:00100000:2.0:1789762979.212503:0:7598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 271 00000100:00100000:2.0:1789762979.212514:0:7598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:13539:x1876702246700544:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:2.0:1789762979.212545:0:7598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789762979.212564:0:7598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff54b600/0x5915dfb1c1b5bdd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a2a expref: 40 pid: 12191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.212596:0:7598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b33fec92100) 00010000:00010000:2.0:1789762979.212602:0:7598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789762979.212616:0:7598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.212623:0:7598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.212629:0:7598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789762979.212695:0:7598:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e7040b1 reply state 000000004b924bed transno 4294967524 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762979.212701:0:7598:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789762979.212705:0:7598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 4096 00000100:00100000:2.0:1789762979.212788:0:7598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:13539:x1876702246700544:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 277us (376us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789762979.212794:0:7598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 271 00010000:00010000:0.0:1789762979.213377:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.213387:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.213394:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.213401:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7460200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762979.213406:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.213414:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.213432:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b33ed2aae00) 00010000:00010000:0.0:1789762979.213435:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789762979.213439:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.213446:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f7460200/0x5915dfb1c1b5bdde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7598 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762979.233157:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.233236:0:9183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246700672 00000100:00100000:0.0:1789762979.233248:0:9183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246700672 00000100:00100000:0.0:1789762979.233328:0:9183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 272 00000100:00100000:0.0:1789762979.233343:0:9183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+40:13545:x1876702246700672:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:0.0:1789762979.233367:0:9183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789762979.233390:0:9183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bde5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a31 expref: -99 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233452:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233464:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233476:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233495:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233502:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233522:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233608:0:9183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bdfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233616:0:9183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233625:0:9183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789762979.233649:0:9183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 4096 00000004:00200000:0.0:1789762979.233653:0:9183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789762979.233667:0:9183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233680:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233686:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233692:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233700:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d000 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762979.233704:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233712:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233734:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b33f721d600) 00010000:00010000:0.0:1789762979.233737:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762979.233741:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233745:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d000/0x5915dfb1c1b5bdec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233802:0:9183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233807:0:9183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233814:0:9183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233821:0:9183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d600 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762979.233827:0:9183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233835:0:9183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233851:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71fbd821 (ffff9b33f721d300) 00010000:00010000:0.0:1789762979.233854:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762979.233858:0:9183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233870:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82d600/0x5915dfb1c1b5bdf3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x71fbd821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233920:0:9183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82dc00/0x5915dfb1c1b5bde5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a31 expref: 42 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233934:0:9183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33ff82c400/0x5915dfb1c1b5bdfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a31 expref: 41 pid: 9183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.233945:0:9183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b33f721d200) 00010000:00010000:0.0:1789762979.233948:0:9183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789762979.233951:0:9183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33ff82c400, rc 0) 00000100:00100000:0.0:1789762979.234004:0:9183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:13545:x1876702246700672:12345-192.168.203.36@tcp:101:dd.500 Request processed in 664us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789762979.234014:0:9183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 272 00000100:00100000:0.0:1789762979.235097:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762979.235145:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246700928 00000100:00100000:1.0:1789762979.235151:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246700928 00000100:00100000:1.0:1789762979.235183:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 273 00000100:00100000:1.0:1789762979.235191:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+41:13545:x1876702246700928:12345-192.168.203.36@tcp:101:dd.500 00010000:00010000:1.0:1789762979.235199:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789762979.235213:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5be01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc03e56b878944a38 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235271:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235283:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235293:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235367:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235374:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235379:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789762979.235586:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:1.0:1789762979.235673:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5be16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235680:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5be16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235685:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5be16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235704:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235717:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235721:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235724:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d200 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:1.0:1789762979.235727:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235731:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235736:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b33f721d200) 00010000:00010000:1.0:1789762979.235738:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789762979.235741:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235745:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d200/0x5915dfb1c1b5be08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789762979.235816:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d14bd076 reply state 00000000817fb205 transno 4294967525 ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762979.235823:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789762979.235840:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d400/0x5915dfb1c1b5be01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a38 expref: 44 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235850:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767d600/0x5915dfb1c1b5be16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xc03e56b878944a38 expref: 43 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.235864:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b33e0c25100) 00010000:00010000:1.0:1789762979.235866:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789762979.235867:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b33f767d600, rc 0) 00000100:00100000:1.0:1789762979.235897:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+44:13545:x1876702246700928:12345-192.168.203.36@tcp:101:dd.500 Request processed in 708us (802us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789762979.235902:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 273 00010000:00010000:0.0:1789762979.236414:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.236423:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.236428:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.236431:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767da00 already unused, calling callback (ffffffffc1aa04f0) 00010000:00010000:0.0:1789762979.236434:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.236438:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.236456:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x4009f790 (ffff9b33e0c25a00) 00010000:00010000:0.0:1789762979.236458:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789762979.236460:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.236464:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b33f767da00/0x5915dfb1c1b5be0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762979.238847:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762979.238877:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701056 00000100:00100000:1.0:1789762979.238882:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701056 00000100:00080000:0.0:1789762979.238920:0:5921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789762979.238927:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 280949798107 time 280962805243 state 0x0 ref 1 00000100:00100000:1.0:1789762979.238939:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 281012805243 time 280962805243 state 0x1 ref 1 00000100:00100000:1.0:1789762979.238957:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 281012805243 time 281676201697 state 0x0 ref 1 00000100:00100000:1.0:1789762979.238965:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+15:2353:x1876702246701056:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762979.238990:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789762979.238996:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.239009:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:1.0:1789762979.239014:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762979.239021:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.239045:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762979.243808:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967747 is committed 00002000:00010000:1.0:1789762979.243876:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1789762979.243881:0:12137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1789762979 00002000:00010000:1.0:1789762979.243883:0:12137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb ctime from disk: 0 -> 1789762979 00002000:00010000:1.0:1789762979.243885:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1789762979.243891:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.243899:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.243905:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.243909:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762979.243912:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.243917:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.243927:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.243942:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762979.243983:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246701056:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5018us (5137us total) trans 4294967747 rc 0/0 00000100:00100000:1.0:1789762979.243990:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 423 00000100:00100000:1.0:1789762979.243997:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 281012805243 time 281676201697 state 0x2 ref 0 00000100:00100000:2.0:1789762979.256288:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.256353:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701184 00000100:00100000:0.0:1789762979.256363:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701184 00000100:00100000:0.0:1789762979.256415:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 281012805243 time 281676201697 state 0x0 ref 1 00000100:00100000:0.0:1789762979.256431:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 2 deadline 281726201697 time 281676201697 state 0x1 ref 1 00000100:00100000:0.0:1789762979.256463:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 281726201697 time 281693704601 state 0x0 ref 1 00000100:00100000:0.0:1789762979.256478:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701184:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762979.256516:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 1048576, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x800 00010000:00010000:0.0:1789762979.256524:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.256539:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:0.0:1789762979.256544:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762979.256561:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.256576:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762979.262353:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967748 is committed 00002000:00010000:3.0:1789762979.262434:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1789762979.262441:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:3.0:1789762979.262454:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.262471:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.262479:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.262485:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82dc00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762979.262489:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.262496:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.262513:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.262518:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ef27e23/0x5915dfb1c1b5be2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762979.262595:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701184:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6119us (6309us total) trans 4294967748 rc 0/0 00000100:00100000:3.0:1789762979.262604:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 424 00000100:00100000:3.0:1789762979.262615:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 281726201697 time 281693704601 state 0x2 ref 0 00000100:00100000:2.0:1789762979.264504:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.264556:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701312 00000100:00100000:0.0:1789762979.264563:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701312 00000100:00100000:0.0:1789762979.264594:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 281726201697 time 281693704601 state 0x0 ref 1 00000100:00100000:0.0:1789762979.264603:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 1 deadline 281743704601 time 281693704601 state 0x1 ref 1 00000100:00100000:0.0:1789762979.264626:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281743704601 time 281701871421 state 0x0 ref 1 00000100:00100000:0.0:1789762979.264635:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246701312:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762979.264657:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 2097152, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x1000 00010000:00010000:0.0:1789762979.264662:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.264671:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:0.0:1789762979.264674:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762979.264678:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.264686:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762979.269290:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967749 is committed 00002000:00010000:0.0:1789762979.269405:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789762979.269410:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:0.0:1789762979.269418:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.269426:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.269433:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.269438:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82d600 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762979.269441:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.269447:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.269458:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.269463:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed629c6/0x5915dfb1c1b5be32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762979.269514:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246701312:12345-192.168.203.36@tcp:4:dd.500 Request processed in 4879us (5012us total) trans 4294967749 rc 0/0 00000100:00100000:0.0:1789762979.269529:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 425 00000100:00100000:0.0:1789762979.269536:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281743704601 time 281701871421 state 0x2 ref 0 00000100:00100000:2.0:1789762979.271363:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.271409:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701440 00000100:00100000:0.0:1789762979.271415:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701440 00000100:00100000:0.0:1789762979.271439:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281743704601 time 281701871421 state 0x0 ref 1 00000100:00100000:0.0:1789762979.271447:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281751871421 time 281701871421 state 0x1 ref 1 00000100:00100000:1.0:1789762979.314697:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281751871421 time 281751928660 state 0x0 ref 1 00000100:00100000:1.0:1789762979.314717:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33ffd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701440:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762979.314783:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 3145728, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x1800 00010000:00010000:1.0:1789762979.314792:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.314805:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:1.0:1789762979.314809:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762979.314814:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.314826:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762979.320805:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967750 is committed 00002000:00010000:1.0:1789762979.320871:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1789762979.320881:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:1.0:1789762979.320889:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.320897:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.320903:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.320908:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762979.320911:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.320918:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.320931:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.320936:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762979.320987:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33ffd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701440:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6276us (49627us total) trans 4294967750 rc 0/0 00000100:00100000:1.0:1789762979.320995:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 426 00000100:00100000:1.0:1789762979.321002:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281751871421 time 281751928660 state 0x2 ref 0 00000100:00100000:2.0:1789762979.323280:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.323362:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701568 00000100:00100000:0.0:1789762979.323370:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701568 00000100:00100000:0.0:1789762979.323407:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281751871421 time 281751928660 state 0x0 ref 1 00000100:00100000:0.0:1789762979.323417:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281801928660 time 281751928660 state 0x1 ref 1 00000100:00100000:2.0:1789762979.364792:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281801928660 time 281802025234 state 0x0 ref 1 00000100:00100000:2.0:1789762979.364812:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c172a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246701568:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762979.364860:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 4194304, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x2000 00010000:00010000:2.0:1789762979.364868:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.364881:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:2.0:1789762979.364894:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762979.364901:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.364914:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762979.371011:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967751 is committed 00002000:00010000:0.0:1789762979.371118:0:12140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1789762979.371124:0:12140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:0.0:1789762979.371131:0:12140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.371140:0:12140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.371146:0:12140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.371170:0:12140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762979.371173:0:12140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.371179:0:12140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.371191:0:12140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.371196:0:12140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762979.371264:0:12140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c172a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246701568:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6458us (47986us total) trans 4294967751 rc 0/0 00000100:00100000:0.0:1789762979.371270:0:12140:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 427 00000100:00100000:0.0:1789762979.371277:0:12140:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281801928660 time 281802025234 state 0x2 ref 0 00000100:00100000:3.0:1789762979.373583:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.373632:0:12139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701696 00000100:00100000:0.0:1789762979.373640:0:12139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701696 00000100:00100000:0.0:1789762979.373672:0:12139:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281801928660 time 281802025234 state 0x0 ref 1 00000100:00100000:0.0:1789762979.373682:0:12139:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281852025234 time 281802025234 state 0x1 ref 1 00000100:00100000:2.0:1789762979.414903:0:6915:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281852025234 time 281852129503 state 0x0 ref 1 00000100:00100000:2.0:1789762979.414943:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246701696:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762979.414996:0:6915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 5242880, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x2800 00010000:00010000:2.0:1789762979.415006:0:6915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.415022:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:2.0:1789762979.415026:0:6915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762979.415033:0:6915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.415049:0:6915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762979.421443:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967752 is committed 00002000:00010000:2.0:1789762979.421536:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1789762979.421543:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:2.0:1789762979.421553:0:6915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.421563:0:6915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.421572:0:6915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.421580:0:6915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461a00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:2.0:1789762979.421584:0:6915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.421594:0:6915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.421612:0:6915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.421621:0:6915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d3e5bf/0x5915dfb1c1b5be47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789762979.421688:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246701696:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6767us (48107us total) trans 4294967752 rc 0/0 00000100:00100000:2.0:1789762979.421705:0:6915:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 428 00000100:00100000:2.0:1789762979.421716:0:6915:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281852025234 time 281852129503 state 0x2 ref 0 00000100:00100000:0.0:1789762979.424251:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1789762979.424307:0:12137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701824 00000100:00100000:1.0:1789762979.424328:0:12137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701824 00000100:00100000:1.0:1789762979.424385:0:12137:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281852025234 time 281852129503 state 0x0 ref 1 00000100:00100000:1.0:1789762979.424398:0:12137:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281902129503 time 281852129503 state 0x1 ref 1 00000100:00100000:3.0:1789762979.465134:0:6917:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281902129503 time 281902352698 state 0x0 ref 1 00000100:00100000:3.0:1789762979.465168:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701824:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762979.465263:0:6917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 6291456, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x3000 00010000:00010000:3.0:1789762979.465279:0:6917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.465334:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789762979.465341:0:6917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762979.465352:0:6917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.465388:0:6917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762979.471602:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967753 is committed 00002000:00010000:3.0:1789762979.471737:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1789762979.471744:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:3.0:1789762979.471754:0:6917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.471782:0:6917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.471801:0:6917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.471808:0:6917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54b200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762979.471812:0:6917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.471819:0:6917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.471836:0:6917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.471842:0:6917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762979.471913:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701824:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6759us (47662us total) trans 4294967753 rc 0/0 00000100:00100000:3.0:1789762979.471922:0:6917:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 429 00000100:00100000:3.0:1789762979.471931:0:6917:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281902129503 time 281902352698 state 0x2 ref 0 00000100:00100000:2.0:1789762979.474450:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.474534:0:12140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246701952 00000100:00100000:0.0:1789762979.474545:0:12140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246701952 00000100:00100000:0.0:1789762979.474594:0:12140:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281902129503 time 281902352698 state 0x0 ref 1 00000100:00100000:0.0:1789762979.474606:0:12140:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281952352698 time 281902352698 state 0x1 ref 1 00000100:00100000:3.0:1789762979.515199:0:12138:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281952352698 time 281952429252 state 0x0 ref 1 00000100:00100000:3.0:1789762979.515223:0:12138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701952:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:3.0:1789762979.515292:0:12138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 7340032, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x3800 00010000:00010000:3.0:1789762979.515302:0:12138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.515339:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789762979.515345:0:12138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789762979.515353:0:12138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.515369:0:12138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789762979.521064:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967754 is committed 00002000:00010000:3.0:1789762979.521166:0:12138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1789762979.521172:0:12138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:3.0:1789762979.521182:0:12138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.521191:0:12138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.521198:0:12138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.521204:0:12138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff54b200 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:3.0:1789762979.521207:0:12138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.521226:0:12138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.521240:0:12138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789762979.521245:0:12138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbc9cfb9/0x5915dfb1c1b5be55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789762979.521332:0:12138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246701952:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6116us (46884us total) trans 4294967754 rc 0/0 00000100:00100000:3.0:1789762979.521343:0:12138:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 430 00000100:00100000:3.0:1789762979.521353:0:12138:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281952352698 time 281952429252 state 0x2 ref 0 00000100:00100000:0.0:1789762979.523541:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1789762979.523588:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246702080 00000100:00100000:2.0:1789762979.523597:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246702080 00000100:00100000:2.0:1789762979.523644:0:6915:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 281952352698 time 281952429252 state 0x0 ref 1 00000100:00100000:2.0:1789762979.523656:0:6915:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282002429252 time 281952429252 state 0x1 ref 1 00000100:00100000:0.0:1789762979.565266:0:6916:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282002429252 time 282002498484 state 0x0 ref 1 00000100:00100000:0.0:1789762979.565285:0:6916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246702080:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762979.565345:0:6916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 8388608, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x4000 00010000:00010000:0.0:1789762979.565353:0:6916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.565366:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=282s v=(0 0) 00010000:00010000:0.0:1789762979.565370:0:6916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762979.565375:0:6916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.565388:0:6916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762979.570914:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967755 is committed 00002000:00010000:0.0:1789762979.570985:0:6916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:0.0:1789762979.570993:0:6916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:0.0:1789762979.571014:0:6916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.571026:0:6916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.571034:0:6916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.571040:0:6916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33ff82da00 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762979.571044:0:6916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.571051:0:6916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.571064:0:6916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.571077:0:6916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762979.571131:0:6916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246702080:12345-192.168.203.36@tcp:4:dd.500 Request processed in 5852us (47593us total) trans 4294967755 rc 0/0 00000100:00100000:0.0:1789762979.571138:0:6916:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 431 00000100:00100000:0.0:1789762979.571144:0:6916:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282002429252 time 282002498484 state 0x2 ref 0 00000100:00100000:2.0:1789762979.573443:0:3410:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1789762979.573492:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246702208 00000100:00100000:3.0:1789762979.573504:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246702208 00000100:00100000:3.0:1789762979.573560:0:6917:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282002429252 time 282002498484 state 0x0 ref 1 00000100:00100000:3.0:1789762979.573573:0:6917:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282052498484 time 282002498484 state 0x1 ref 1 00000100:00100000:2.0:1789762979.615387:0:12139:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282052498484 time 282052614382 state 0x0 ref 1 00000100:00100000:2.0:1789762979.615414:0:12139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246702208:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:2.0:1789762979.615474:0:12139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 9437184, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x4800 00010000:00010000:2.0:1789762979.615483:0:12139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.615499:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=282s v=(0 0) 00010000:00010000:2.0:1789762979.615504:0:12139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789762979.615510:0:12139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789762979.615523:0:12139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762979.621454:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967756 is committed 00002000:00010000:0.0:1789762979.621556:0:12139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:0.0:1789762979.621566:0:12139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 18432 -> 20480 00010000:00010000:0.0:1789762979.621579:0:12139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.621593:0:12139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.621603:0:12139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.621611:0:12139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f7461800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:0.0:1789762979.621616:0:12139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.621627:0:12139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.621647:0:12139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.621653:0:12139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91327b1/0x5915dfb1c1b5be63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789762979.621726:0:12139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b32c4de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246702208:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6320us (48283us total) trans 4294967756 rc 0/0 00000100:00100000:0.0:1789762979.621748:0:12139:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 432 00000100:00100000:0.0:1789762979.621801:0:12139:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282052498484 time 282052614382 state 0x2 ref 0 00000100:00100000:3.0:1789762979.623922:0:3412:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.623994:0:12138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246702336 00000100:00100000:0.0:1789762979.624002:0:12138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246702336 00000100:00100000:0.0:1789762979.624041:0:12138:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282052498484 time 282052614382 state 0x0 ref 1 00000100:00100000:0.0:1789762979.624052:0:12138:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282102614382 time 282052614382 state 0x1 ref 1 00000100:00100000:1.0:1789762979.665506:0:12137:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282102614382 time 282102730529 state 0x0 ref 1 00000100:00100000:1.0:1789762979.665533:0:12137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b33f47f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246702336:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:1.0:1789762979.665596:0:12137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 10485760, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x5000 00010000:00010000:1.0:1789762979.665614:0:12137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.665631:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=282s v=(0 0) 00010000:00010000:1.0:1789762979.665636:0:12137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789762979.665641:0:12137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.665656:0:12137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789762979.671576:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967757 is committed 00002000:00010000:1.0:1789762979.671710:0:12137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789762979.671716:0:12137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 20480 -> 22528 00010000:00010000:1.0:1789762979.671730:0:12137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.671765:0:12137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.671775:0:12137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.671780:0:12137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b33f767d800 already unused, calling callback (ffffffffc0e83350) 00010000:00010000:1.0:1789762979.671784:0:12137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.671792:0:12137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.671811:0:12137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789762979.671818:0:12137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca21c05/0x5915dfb1c1b5be6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789762979.671895:0:12137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b33f47f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2353:x1876702246702336:12345-192.168.203.36@tcp:4:dd.500 Request processed in 6368us (47972us total) trans 4294967757 rc 0/0 00000100:00100000:1.0:1789762979.671904:0:12137:0:(nrs_tbf.c:2952:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.36@tcp, seq: 433 00000100:00100000:1.0:1789762979.671915:0:12137:0:(nrs_tbf.c:1465:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282102614382 time 282102730529 state 0x2 ref 0 00000100:00100000:2.0:1789762979.674364:0:3411:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1789762979.674452:0:6916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876702246702464 00000100:00100000:0.0:1789762979.674467:0:6916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876702246702464 00000100:00100000:0.0:1789762979.674540:0:6916:0:(nrs_tbf.c:1485:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282102614382 time 282102730529 state 0x0 ref 1 00000100:00100000:0.0:1789762979.674558:0:6916:0:(nrs_tbf.c:2897:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282152730529 time 282102730529 state 0x1 ref 1 00010000:00010000:1.0:1789762979.706900:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789762979.715544:0:12140:0:(nrs_tbf.c:2821:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff9b33f7744000 key jobid={dd.500}&nid={192.168.203.36@tcp}&opcode={ost_write}&uid={500}&gid={500}&projid={0}&nodemap={-1} rule@0xffff9b33f73f2700 gen 0 rate 20 depth 3 token 0 deadline 282152730529 time 282152776180 state 0x0 ref 1 00000100:00100000:0.0:1789762979.715567:0:12140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b32c4de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f07ac6c5-9215-4651-bbbc-5b452d5bdd86+7:2354:x1876702246702464:12345-192.168.203.36@tcp:4:dd.500 00002000:00010000:0.0:1789762979.715616:0:12140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 11534336, mtime: 0x6aad9da3, atime: 0x0, ctime: 0x6aad9da3, blocks: 0x5800 00010000:00010000:0.0:1789762979.715623:0:12140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.715637:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=282s v=(0 0) 00010000:00010000:0.0:1789762979.715641:0:12140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789762979.715657:0:12140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789762979.715668:0:12140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b42b63/0x5915dfb1c1b5be71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 Debug log: 44502 lines, 44502 kept, 0 dropped, 0 bad.